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Description 

Background of the Invention 

5 [0001] The present invention relates to image processing method and apparatus, for improving the properties (e.g., 
improving the comparison precision, reducing the processing amount, decreasing the amount of data, etc.) In the case 
when conducting image processing for analyzing or recognizing a digitalized image (e.g. , fingerprints, stamped images, 
diagrams, characters, etc.) using an image processing apparatus (i.e., hardware/software in a computer, electronic 
switching machine, communication control unit, IC card, image recognition device, image comparing device, image 

10 testing unit, or the like). 

Related Art 

[0002] In the following, an example of the case in which the objective image according to the present invention is a 

is fingerprint will be explained. Essentially, a fingerprint is the crest pattern of the ridges of a finger. Furthermore, since 
the trough lines (the space in between the ridge lines) are defined by the ridge lines, it is possible to use a pattern 
formed by trough lines in place of the ridge lines as a fingerprint. For the sake of convenience, the lines defining the 
fingerprint will be called "fingerprint lines". Various fingerprint input devices exist for confirming an individual's identity, 
such as a method for inputting a fingerprint from an image pick-up unit (e.g., CCD (Charged Coupled Device)) camera, 

20 a prism method (e.g., see Shimizu et al., "Entry Method of Fingerprint Image with a Prism - Comparison between Total 
and Light Path Separation Method", IECE Journal, vol. J68-D, No. 3, pp. 414-415 (1985)), and a hologram method (e. 
g., see Igaki, et al., "Personal Identification Terminal Using a Holographic Fingerprint Sensor", Institute of Electronics 
and Communication Engineers of Japan (IEICE Technical Report, PRU87-31 , pp. 27-33, (1987)). 
[0003] The fingerprint image of analog information inputted from an image pick-up unit is converted into a gray-scale 

25 image of a digitalized fingerprint by means of an analog/digital (A/D) converter. The gray-scale image of this fingerprint 
is represented by the coordinates (X, Y) which are an image memory pixel address, as well as by means of the bright- 
ness of the pixels which form the structural components of each image memory pixel address. The designation method 
for the X and Y axes is optional and may be freely selected. The fingerprint image may be formed by converting the 
concavities and convexities of the fingerprint directly into a binary image. 

30 [0004] Corrections can then be conducted on the gray-scale image of the fingerprint by means of leveling and utilizing 
the orientation of the ridges. End points/branch points, and points of intersection represent characteristic points which 
display the distinctive features of a fingerprint. The characteristic points of a gray-scale image of a digitalized fingerprint 
can be detected by means of conducting binary conversion of a fingerprint image and further thinning this image and 
examining whether or not a pattern identical to the pattern of a range of pixels (e.g., a 3 x 3 pixel aggregation with the 

35 characteristic point as the center) representing the characteristic point (e.g., see. Sasagawa, et a!., "Personal Verifi- 
cation System with High Tolerance of Poor-Quality Fingerprints", IEICE Journal, vol. J72-D-II No. 5, pp. 707-71 4 (1 990)) 
exists. In the comparison of fingerprints, fingerprints for which information has been previously recorded in memory 
are referred to as "registered fingerprints" (i.e., registered images or registered fingerprint images), and the fingerprint 
which is compared for concordance with the aforementioned registered fingerprints are referred to as "test fingerprints' 1 

40 (i.e., test images or test fingerprint images). As methods for comparing the registered fingerprints and the examined 
fingerprints, a method utilizing characteristic points, a method utilizing the orientation of the ridge lines, and a method 
for matching the patterns of the original images of the examined fingerprint and the registered fingerprint are known. 
Japanese Patent Application, First Publication, No. Sho 63-1 32386 discloses a method for comparing fingerprint im- 
ages, in which the thinned image of an examined fingerprint and a thinned image of the registered fingerprint are 

45 superimposed as a method for pattern matching for thinned images (see Kubota, et al., "Fingerprint Comparing Meth- 
od"). 

[0005] Smoothing is a process for reducing the effects of noise of the fingerprint image; e.g., a local summation 
averaging filter which utilizes the values of neighboring pixels surrounding a random pixel (Takagi and Shimoda (Eds.), 
"Handbook of Image Analysis", pp. 538-548, Tokyo University Press (1991)). 

so [0006] With regard to the thinning process of a binary image, various pixels corresponding to lines exist, such that 
the majority (in this case, "majority" means at least one-half, and ideally, the entire portion) of the line widths represent 
1 pixel. The various kinds of corresponding pixels are either black or white; in the following, an explanation will be given 
with regard to the black pixels. Hilditch's thinning method, in which the outer black pixels of a black pixel aggregation 
are sequentially deleted while maintaining the continuity between black pixels, is known as a method for thinning a 

55 binary image following binary conversion of the gray-scale image (4-neighbor connected or 8-neighbor connected). In 
addition, other methods for thinning a gray-scale image or a binary image are also known; e.g., Tamura (Ed.), "Intro- 
duction to Computer Image Processing", Sougen Press, pp. 80-83 (1985); Tamura, "Research Relating to Mufti-sided 
Image Processing and its Software", Electrotechnical Laboratory Japan Research Report, pp. 25-64, No. 835 (February 
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1 984); and Mori, et al., "Fundamentals of Image Recognition [I]", pp. 75-71 , Ohm Corporation (1 986). Japanese Patent 
Application No. Hel 3-451 36 (1 991 ), "A Thinning Method for Extracting Characteristic Points of an Image," (Kobayashl, 
et al., Institute of Electronics, Information and Communication Engineers of Japan [IEICE] Technical Report, 
PRU90-1 49, pp. 33-38 (1 991 )) discloses a method for thinning a gray-scale image or a binary image. As for connectivity 
5 between blackpixels, either 4-neighbor connected or 8-neighbor connected is used. 4-neighbor connected and 8-neigh- 
bor connected are also called 4-connected and 8-connected, respectively (e.g., see "Introduction to Computer Image 
Processing", Tamura (Ed.), Soken-Suppan, pp. 70, (1985)). 

[0007] A method for binary converting a gray-scale image into a binary image is disclosed in Mori, et al., ("Funda- 
mentals of Image Recognition [IJ", pp. 37-47, Ohm Corporation (1 986)). A p-tile method is known as a method for binary 
10 conversion, in which a binary conversion threshold value is determined such that the proportion of black pixels among 
all of the pixels in question following binary conversion (i.e., black or white pixels) reaches a predetermined value (e. 
g., Takagi and Shlmoda (Eds.), "Handbook of Image Analysis", p. 503, Tokyo University Press (1991)). However, this 
process cannot be directly applied to the case when binary conversion is carried out by means of dividing the image 
into partial regions. 

is [0008] With regard to the input of fingerprints, positional errors (rotational and parallel displacements) occur when 
comparing a test fingerprint with a registered fingerprint, and hence when carrying out comparison, it is necessary to 
align these two fingerprints. As methods for aligning the aforementioned fingerprints (rotational and parallel displace- 
ments), a method which utilizes the ridge orientation, a method which utilizes representative characteristic points and 
peripheral characteristic points, and a method which applies trial and error practice over a range in which only parallel 

20 displacement is possible to produce a final position of maximum concordance, are known. Furthermore, at the time of 
aligning, a conventional method for performing the required coordinate and geometric transformations is disclosed in 
Plastock, et al., ("Theory and Problems of Computer Graphics", translated by Koriyama), pp. 84-88, McGraw Hill Books 
(1987)). 

[0009] In the aligning at the time of comparison, it is useful to calculate the approximate center point of a fingerprint 
25 image. A method for calculating the approximate center point by means of successively examining ridges with sharp 
increases in their gradients is disclosed in Japanese Patent Application, Second Publication, No. Sho 58-55548 ("A 
Method for Determining the Center Position of a Diagram"). In Ito, etal., ("An Algorithm for Classification of Fingerprints 
Based on the Core", IEICE Technical Report, PRU 89-79, pp. 15-22 (1989)). A method for successively accessing a 
center position using the number of intersections of parallel lines of each rectangular region is disclosed. In addition, 
30 in "An Extraction Technique of the Pirot Location for Automated Fingerprint Identification Process" (IEICE National 
Conference on Information and Systems, No. 125 (1987), a method is disclosed for calculating the distribution of the 
number of lines present by counting the number of ridge lines passing through each scanning line. 
[0010] Kobayashi ("A Template Matching Scheme for Fingerprint Image Recognition", IEICE Technical Report, 
PRU91 45, pp. 25 30, July 1991)) discloses a method for comparing black pixels extracted from a thinned image (or 
35 narrowed image) of a registered fingerprint and the binary image (or narrowed image) of a test fingerprint wherein the 
processing amount and memory capacity have been decreased to a greater degree than in the process for comparing 
two binary images. 

[0011] In consideration of the conservation of memory for registered information, it is necessary to decrease the 
memory quantity as much as possible. In the present invention, it is necessary to record the narrow processed binary 

<o image (line figures) as registered information. As a method for storing line figures, a method is known which uses 
Freeman chain codes (e.g., Yasui and Nakajima, "Image Information Processing", pp. 113-114, Morikita Publishing 
(1 991 )) ; however, the application of this method to complex images, as in the case of a fingerprint, is extremely difficult. 
[0012] Conventionally, methods such as reversion of the fingerprint lines, thinning, and comparison alignment, for 
example, represent procedures with a large processing amount, at the time of comparison of the fingerprint image. In 

45 addition, in the comparison method which utilizes characteristic points (end points, branch points, points of intersection) 
of the image, due to reversion of the fingerprint lines, the processing amount is large, and in addition, comparison is 
difficult in the case when the characteristic points are unclear or indistinct, and when the number of these characteristic 
points Is small. In the comparison process which utilizes pattern matching of the original images of a registered finger- 
print and a test fingerprint, at the time of sealing, the width of the ridge lines of the fingerprint are altered due to factors 

so such as the pressure of the finger, existence of a dry state, and the like, and hence, errors are easily generated and 
a large memory capacity is necessary to store the registered information. 

[0013] EP-A-0 508 845 from the same inventor describes a method and an apparatus for image processing for 
comparing fingerprints and the like. To avoid reducing the accuracy of the comparison due to the variations of the 
fingerprint lines when the fingerprint input is made, a method has been resolved wherein the line width of the registered 
55 fingerprint is narrowed more than the line width of the tested fingerprint Reduction of the throughout of recording and 
comparison Is solved by the selective utilization of the input of an activated fingerprint image, the judging of the finger- 
print boundaries and the processing of only the activated division, and, additionally, In the comparison, by midway 
abandonment, midway decision, multi-step variation of the increment, and/or Introduction of a subtemplate jump search. 
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By introducing the degree of discordance between two images, it becomes possible to compare two images based on 
a comparison of the black pixels of the registered image to those of the image undergoing testing. As a result, the 
processing amount for position matching is reduced in comparison with the case when ail black pixels of two Images 
are checked, or the entire images, including black and white pixels, are checked. Reduction of the amount of processing 

s required for registration and comparison is resolved by setting the black pixel address of the narrowed image of the 
registered fingerprint to recorded information as a subtempiate and a non subtemplate, by creating a storage form 
which takes into consideration the narrowed image by means of the storage of registered information, and by carrying 
out the reduction of registered data. Reduction of the throughput of narrowization processing (including thinning) was 
resolved by the direct detection of the centre point of a black pixel aggregation, and by a performed judging table. 

10 [0014] An article by Wei-Chung Lin and Richard C. Dubes entitled « A Review Of Ridge Counting In Dermatoglyphics 
» (Pattern Recognition, 1 983, UK, vol. 16, no. 1 , ELMSFORD, NY US, pages 1 -1 8) discloses that a fingerprint ridge 
count is the number of ridges which intersect a straight line drawn from the central point of a triradius to the center of 
a fingerprint pattern, and that the threshold is selected to make the number of black pixels approximately equal to the 
number of white pixels in order to obtain a smoothed image by thresholding. 

15 

Summary of the Invention 

[0015] it is an objective of the present invention to provide an image processing method and apparatus comprising 
one or more means for improving the comparison properties of a fingerprint or similar image. 

20 [0016] Said method and apparatus are more precisely defined in claim 1 and in claim 2. 

[0017] in an embodiment of the comparing method and apparatus according to the present invention, the information 
(the address group of black pixels extracted from a specified range of the image) extracted from a binary image pro- 
duced by binary converting, and thinning or narrowing a registered image, and the binary image of a test image are 
aligned and the concordance of their black pixels are checked to judge whether or not a positive identification (i.e., 

25 whether or not an individual's identity can be confirmed) can be made. 

[0018] In the following, an outline of the essential components of the image processing apparatus and method for 
the same according to the present invention will be explained. 

[0019] Increasing the comparison precision in order to improve the image processing properties is accomplished by 
means of selectively utilizing a means forjudging whether the concordance or discordance degree meets specified 
30 conditions when the ratio of the total number of black pixels to the total pixels falls within a specified range; a means 
for checking the presence and position of a hole generated by a white pixel aggregation within a blackpixel aggregation; 
a means for examining neighboring pixels when comparing binary converted images; and a means for registering the 
optimum image obtained from reciprocal comparison of one or more images. 

[0020] Increasing the quality of the image in order to improve the image processing properties is accomplished by 
35 means of selectively utilizing a means for performing binary conversion using a threshold value which is obtained by 
means of calculating the average brightness for each partial region is calculated, and converting the average brightness 
values in reciprocal intervals of the partial regions; a means for performing binary conversion of portions in which little 
variation of the brightness occurs; and a means for repeatedly performing binary conversion in order to keep the ratio 
of the total number of black pixels to the total number of black and white pixels within a fixed range. 
40 [0021] Decreasing the processing amount for comparison in order to improve the image processing properties is 
accomplished by means of selectively utilizing a means for sequentially judging the degree of concordance at each 
partial alignment interval such that in the case when image concordance is detected, the comparison process is not 
conducted for partial alignment intervals following the partial alignment interval in which concordance was detected; 
and a means for comparing m number of partial alignment intervals (m £ 1 , and is a predetermined constant), and for 
45 determining discordance when the maximum degree of concordance over these Intervals is less than a specified value. 
[0022] In the case when calculation of the degree of discordance during the comparison process is undesirable, 
improvement of the image processing properties is achieved by selectively utilizing a means for using information of 
a reversed image as reversed registered information and then comparing the registered information of this reversed 
registered image, and a reversed test image. 

50 

Brief Description of the Drawings 

[0023] FIG. 1 shows a structural example of a fingerprint recognition system according to an embodiment of the 
present Invention. 

55 [0024] FIG. 2A is a diagram illustrating an arrangement of the image memory of Fig. 1 . 
[0025] FIG. 2B is a diagram illustrating an arrangement of the memory of FIG. 1 . 
[0026] FIG. 3A shows an example of 3x3 pixel aggregation. 
[0027] FIG. 3B shows an example of 4x4 pixel aggregation. 



4 



EP0 623 890 B1 



[0028] FIG. 3C shows examples of 4x3 pixel aggregations. 

[0029] FIG. 4 shows examples of the divisions of a sub-template and non-sub-template with regard to a fingerprint 
region. 

[0030] FIG. 5 Is a flowchart showing an outline of a procedure IN for continuously confirming the validity of the image 
5 Input and for designating an image. 

[0031] FIG. 6 is a diagram for use in explaining the modification of a processing range of an image. 

[0032] FIG. 7 Is an example of the division of an image into partial regions; this figure is for use in explaining the 

variation of the average brightness of a partial region. 

[0033] FIG. 8 is a flowchart showing an outline of a binary conversion process occurring in a partial region in which 
10 there is little variation of the brightness. 

[0034] FIGS. 9A and 9B show an outline example of a process for standardizing the ratio of binary converted black 

pixels of a binary image which has been divided into partial regions. 

[0035] FIG. 10 is an example of a table of a valid partial portion of a fingerprint. 

[0036] FIGS. 11 A and 11 B are diagrams for use in explaining a hole (white pixel aggregation) and a non-hole re- 
's spectively. 

[0037] FIGS. 12A, 12B, 12C and 12D are diagrams for use in explaining the change from a memory format to a 
compression format of a binary image. 

[0038] FIGS. 13A and 13B depict a flowchart showing an outline of a comparison process based on procedure C. 
[0039] FIG. 14 is a diagram for use in explaining a method for checking discordant portions in a comparison process. 
20 [0040] FIG. 1 5 is a flowchart showin g an outline of an auxiliary procedure (procedure W) for checking the concordance 
of images in a comparison process. 

[0041] FIG. 16A is a diagram illustrating an example of the neighboring pixels search in the comparison process. 
[0042] FIG. 16B is a flowchart of the reciprocal relationship of concordance and approximate concordance. 
[0043] FIG. 1 7 is a flowchart showing an outline of the fingerprint registration and comparison processes. 
25 [0044] FIG. 1 8 is a flowchart showing an outline of a registration process wherein the optimum registered fingerprint 
from among a plurality of input images is selected. 

[0045] FIG. 19A is a diagram showing a comparison relationship between one test fingerprint and N registered fin- 
gerprints. 

[0046] FIG. 19B Is a flowchart of the comparison of the one test fingerprint against the N registered fingerprints 
30 shown in FIG. 19A. FIG. 20A is a flowchart of the registration process when using a white/black reversed image. 
[0047] FIG. 20B is a flowchart of the comparison process when using a white/black reversed image. 

Detailed Description of the Preferred Embodiments 

35 [0048] In the embodiments of the present invention, the case in which a fingerprint (also referred to hereafter as 
"fingerprint image") is used as the image is presented. FIG. 1 shows a structural example of a fingerprint identification 
system. The fingerprint input from image input unit 2 is processed in image processing unit 1. Image processing unit 
1 comprises image memory 4 for storing a gray-scale image, a binary image, and various processed images of the 
digitalized fingerprint; central processing unit 5 formed from at least one CPU; and memory 6 for recording information 

<o such as programs, data, data collections, and the like. In the case when a special recording unit is included in memory 
6 (e.g., semi-conductor memory, magnetic disc or the like), during mutual intervals, the movement of information is 
performed when necessary by means of hardware and/or software. 

[0049] Image memory 4 and memory 6 are classified according to the stored information, however, it is also possible 
to incorporate both of these memories into the same recording unit. Image input unit 2 comprises an image pick-up 

45 unit 7. A/D converter 3 converts analog information into digital information (in the case when various Image Input units 
which can directly receive digital image are used, an A/D converter is unnecessary). The pixel address in image memory 
4 for storing fingerprint images (gray-scale Images of digitalized fingerprints) is represented by means of X and Y 
coordinates (X,Y). Pixel address (X,Y) may be indicated by "pixel (X, Y) B or simply M (X,Y)°. The portion of image memory 
4 storing a single image is referred to as "image plane". Image memory 4 may hold at least one image plane. In addition, 

so pixel address may also be referred to as simply "address". 

[0050] Each image plane in image memory 4 is constructed of image pixels, and when the domains of all of the pixel 
addresses are set to 0 £ X £ Xh and 0 £ Y £ Yh, the processing domain specified in the domain these pixel addresses 
is processed. In the case when a number with a decimal is generated for the pixel address or the number of pixels by 
means of calculating the sum of the pixel addresses and the number of pixels, processing is performed by rounding 

55 of these numbers (i.e., 4 or less, round down; 5 or greater, round up to nearest integer). The value of a pixel is expressed 
by Its brightness. The portion of the brightness defining a ridge depends upon the processing of an image in image 
processing unit 1, and upon the processing method of image Input unit 2. In both cases, processing is possible by 
means of presetting brightness characteristics corresponding to ridges into image processing unft 1 . 
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[0051] An aggregation of one or more pixels is referred to as "pixel aggregation". In fingerprint recognition, the fin- 
gerprint which is inputted from image Input unit 2 for entry into memory 6 of image processing unit 1 is referred to as 
"registered fingerprint", and the fingerprint which is Inputted from image input unit 2 for testing is referred to as "test 
fingerprint". In an image which has been binary converted into black and white pixels, either the black pixels or the 

5 white pixels may be selected as the objective pixel corresponding to the ridge lines or trough lines of a fingerprint. In 
embodiments of the present invention, the fingerprint lines will be comprised of black pixels. 
[0052] Thinning is a process in which the majority portion of a line width is set to equal one pixel. However, in the 
embodiments of the present invention, the partial or entire narrowing of the line widths of a black pixel aggregation so 
that they are included in an image formed by means of the black pixels of an original binary Image will be referred to 

10 as "narrowing process". Accordingly, an image obtained as a result of this narrowing process will be referred to as 
"narrowed image". In the embodiments of the present invention, thinning is one type of narrowing process. Furthermore, 
a line width is defined as the shortest distance (number of pixels) required to travel from a random point on the margin 
of one line to the opposite margin of the same line, passing through the inner portion of the line. Hence, a line width 
can be set for each margin position of a line. 

15 [0053] FIG. 2A shows the state of the image data stored in image memory 4. Digitalized images (binary images or 
gray-scale images) obtained from the image inputted from image input unit 2 are stored in the image planes of image 
10. In the image planes of image 11, for example, images at the time of input are stored, and can be utilized in the 
processing of image 10. Depending on the selection of the processing procedure, image 11 may be unnecessary (in 
this case, it is possible for memory 4 to utilize only image 10). It is also possible to conduct image processing using 

20 memory 6 by transferring an image from image memory 4 to memory 6. FIG. 2B shows the state of data stored in 
memory 6. Program and data 1 2 store the programs and data for use in achieving the embodiments of the present 
invention, while registered information 13 places and maintains the registered information of a registered fingerprint 
image in a file. 

[0054] With regard to the pixels of an image, a value corresponding to the brightness therein is defined. The bright- 
25 ness of a pixel address (X,Y) is indicated by f (X,Y). Depending on the method of image input, a gray-scale image 
designated by image memory 4 may be produced by means of binary conversion, or a binary image may be directly 
designated by image memory 4. A gray -scale image is an image in which various brightness values exists; this variable 
region of brightness can be applied to random gray-scale images as an objective of the present invention. However, 
for sake of convenience, in the embodiments of the present invention, in the case when numerical values are mentioned, 
30 the brightness will vary between 0 and 255, with 0 representing the lowest brightness level (black), and 255 representing 
the highest brightness level (white). Intermediate values therein represent successive values of the brightness between 
black and white. 

[0055] A binary image is expressed by means of black pixels and white pixels only, and the values corresponding 
to the brightness of these respective black and white pixels are defined. The selection of black pixels to represent 

35 sections of a high brightness or sections of a low brightness is determined by the desired image and method of input; 
in the embodiments of the present invention, either case is possible. In the following, in the case when consideration 
must be given to values of brightness (e.g., in the case when stating values relating to the brightness), with regard to 
binary images, the brightness of a black pixel is 0, and the brightness of a white pixel is 255. 
[0056] The theoretical origin and coordinate axes of an image stored in image memory 4 may be independently 

^o defined as the position of a pixel of a physical image memory 4. The X and Y axes may be randomly designated, 
however, forthe sake of convenience, the X-axis possesses a horizontal orientation from left to right (i.e., in the direction 
of increasing value X), and the Y-axis possesses a vertical orientation from top to bottom (i.e., in the direction of in- 
creasing value Y). 

[0057] An aggregation of at least one pixel is referred to as "pixel aggregation". FIG. 3 (a) is a pixel aggregation 
45 formed from pixels arranged in 3 x 3 pixels (i.e., 3 pixels x 3 pixels); FIG. 3 (b) is a pixel aggregation formed from pixels 
arranged in 4 x 4 pixels; and FIG. 3C is a pixel aggregation formed from pixels arranged in 4 x 3 pixels. In FIG. 3A, 
pixels {P 1 , P 3 , P 5 , P 7 } represent the 4-neighbor connected pixels of P 0 ; pixels {P t , P 2 , P 3 , P 4 , P 5 , P 6 , P 7 , Prf represent 
the 8-neighbor connected pixels of P 0 . 

[0058] In the embodiments of the present invention, division is performed only when the denominator is not zero. 
so [0059] Notations and definitions used hereafter will be defined below. Some of these notations, however, may not 
appear in the embodiments. 



55 



[m]: Indicates the rounding down of an optional number m. 

N: Indicates a connection of two numbers of the values shown (e. 

g. 1 II0II1 =101). 

~: Indicates the range between two numbers (e.g., a - b indicates 

the range between a and b which includes both a and b). 
f (X,Y): Indicates the brightness of pixel address (X,Y). 
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Fingerprint region; the area inside of this fingerprint region is 

considered the fingerprint boundary. 

Address of the approximate center point of a fingerprint. 

Address of the approximate center point of a registered finger- 

print. 

Address of the approximate center point of a test fingerprint. 
Modified image of a registered fingerprint produced by perform- 
ing at least the narrowing process on the binary image (first 
Image) of a registered fingerprint obtained from a registered 
fingerprint image (gray-scale image or binary Image). 
Modified image of a test fingerprint produced by means of ad- 
justing the ratio of the black pixels and/or performing a narrow- 
ing process on the binary image (second image) of a test fin- 
gerprint obtained from a test fingerprint image (gray-scale im- 
age or binary image). 

Aggregation of all address (X,Y) of black pixels within the fin- 
gerprint region of the modified image Rth of a registered finger- 
print; RA is the sum aggregation of RT(0), RB(0), and black 
pixels within the unused portion of a fingerprint region. 
RT(0) is a partial aggregation of RA; RT(0) may designate a 
sub-region of RA in which at least one randomly separated re- 
gions of the pixel aggregation exist; RT(0) is referred to as "sub- 
template"; the portion of an image which extracts the sub-tem- 
plate is often referred to as "sub-template portion"; the sub-tem- 
plate is used in the aligning of images (see FIG. 4). 
RB(0) is a partial aggregation of RA which may designate a 
sub-region of RA one or more randomly separated regions of 
the pixel aggregation; RB(0) is referred to as "non -sub-tem- 
plate"; the portion of an image which extracts the non-sub-tem- 
plate is often referred to as "non-sub-template portion"; the sub- 
template is not used in the aligning of images. RT(0) and RB 
(0) are designated such that they do not overlap (see FIG. 4). 
The aggregation of black pixel addresses (X, Y) of sub-template 
RT(0) at the time when the coordinate axes of the modified im- 
age of the registered fingerprint is rotated S degrees (S°) 
around a randomly defined center point 
The aggregation of addresses of sub-template RT(0) in the co- 
ordinate axes following S° rotation of the coordinate axes of 
the modified image of the registered fingerprint around a ran- 
domly defined center point (e.g., the approximate center point 
of a registered fingerprint), as well as, after conducting horizon- 
tal displacement H and vertical displacement V; RT(0, 0, 0) = 
RT(0) and RT(S, 0, 0) = RT(S); (further, one pattern which is 
displaced by means of coordinate conversion of the modified 
image of a registered fingerprint is defined by means of the val- 
ues of set {S, H, V} which designates a displacement position.). 
The aggregation of addresses of non-sub-template RB(0) in the 
coordinate axes following S° rotation of the coordinate axes of 
the modified image of the registered fingerprint around a ran- 
domly defined center point (e.g., the approximate center point 
of a registered fingerprint), as well as, after conducting horizon- 
tal displacement H and vertical displacement V; RB(0, 0, 0) = 
RB(0) and RB(S, 0, 0) = RB(S). 

The number of concordant black pixels of the sub-template; in- 
dicates the number of concordant black pixels between the 
sub-template of the modified image of the registered fingerprint 
and the modified image of the test fingerprint. 
The total number of black pixels of the sub-template; Indicates 
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N2m: 

5 

N2c: 

10 Nm: 
Nc: 

Partial region: 

15 

Interval [a, b]: 
Alignment Interval: 

20 

Partial alignment interval: 

25 

Displacement position: 

30 Registered fingerprint (registered image): 

Test fingerprint (test image): 
Threshold value: 

35 



the total number of black pixels in the sub-template of the mod- 
ified image of the registered fingerprint. 
The number of concordant black pixels of the non-sub-tem- 
plate; indicates the number of concordant black pixels between 
the non-sub-template of the modified image of the registered 
fingerprint and the modified Image of the test fingerprint. 
The total number of black pixels of the non-sub-template; indi- 
cates the total number of black pixels in the non-sub-template 
of the modified image of the registered fingerprint. 
Indicates N1m or N2m; Counter Nm is the value of the counter 
in the calculation of Nm. 

Indicates N1c or N2c; Counter Nc is the value of the counter in 
the calculation of Nc. 

The individual regions which result from the division of an im- 
age into a plurality of parts. 

Indicates the interval between two optional values, a and b, 
which includes both a and b. 

Indicates the range over which an image is displaced in order 
to align two images (group of displacement intervals for each 
direction), and is constructed from {rotational displacement in- 
terval, horizontal displacement interval, vertical displacement 
interval}. 

The individual alignment intervals resulting from division of an 
alignment interval into at least one partial group; the entire 
alignment interval is the aggregate sum of at least one partial 
alignment interval. 

Position expressed by one group {rotational displacement po- 
sition, horizontal displacement position, vertical displacement 
position). 

Registered fingerprint image or modified image of a registered 
fingerprint. 

Test fingerprint image or modified image of a test fingerprint. 
A constant value for use in making judgments using the ratio 
of an evaluation value to a threshold value; the method for de- 
fining a threshold value differs for each evaluation value. 



[0060] FIG. 4 shows an example of the relationship of a fingerprint region defined by means of a fingerprint boundary 
to the portion for extracting sub-template RT(0) and to the portion for extracting non-sub-template RB(0), in image 10 
of image memory 4, Examples 1 - 3 are examples of the sub-template and non-sub-template portions. 

40 [0061] In the following, the procedure for processing a fingerprint image will be explained. Further, with regard to 
each step of the procedure, in the case when the subsequent process is not mentioned, the procedure progresses to 
the subsequent step. The constants used in each step take into consideration the various conditions of image process- 
ing unit 1 and image input unit 2, and designate statically or dynamically appropriate value. The realization of each 
step as well as the processes linked therein, may be modified provided that the contents of the processing remain the 

45 same. 

(1) Means for designating a Fixed Moment of Input from Image Input Unit to Image Memory 

[0062] Image 1 0 which is inputted from image input unit 2 to image memory 4 varies according to the movement the 
so object of image pick-up unit 7 (i.e., In the case when the object is a fingerprint, a finger is put on image input unit 2). 
As a result, it is necessary to define the moment which designates Image 10 of image memory 4. This processing 
method comprises: 

(a) A method for recognizing the fixed moment of an image by means of a signal sent from image input unit 2 to 
55 image processing unit 1 ; 

(b) A designating method by means of which a user designates the fixed moment of an image to image processing 
unit 1; or 

(c) A defining method by means of which Image processing unit 1 defines the fixed moment of an image by means 
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of checking the state of image 1 0 of image memory 4. 
[0063] In the following, an example of method (c) will be provided. 

[0064] When the gray-scale Image of a fingerprint has been correctly inputted, the average brightness value lies 
s within a fixed range, and when this state continues, a stable image can be obtained. Utilizing this aspect, in order to 
increase the quality of the Image defining this input, the average brightness value of a previously defined pixel aggre- 
gation of the image (e.g., the entire region of the image or one or more partial regions) is calculated. When this average 
brightness meets specific conditions, the aforementioned image is judged to be a valid image, and when this process 
is continued such that the number of valid images recognized exceeds a specified number, the last Image of Image 
io memory 4 which is temporarily fixed is designated. 

[0065] Based on the aforementioned, an example of the designating method for designating the fixed moment of 
image input is shown in procedure IN. 

(Procedure IN) 

15 

[0066] 

Step IN1: 

Counter Fa is reset to M 0". 
20 Step IN2; 

The image input process is commenced, and image of the image memory is temporarily fixed. 
Step IN3: 

Within a specified region of the image, the average brightness E av of this specified region is calculated, and 
when this average brightness of this specified region meets certain conditions, the image is judged to be valid, 
25 and the procedure moves to step IN4. If the average brightness does not meet the aforementioned conditions, the 

image is judged to be invalid, and the procedure returns step IN1 . 

Average brightness E av of a specified region = 

30 

(Sum of brightness of pixels within the specified region) / (total number of pixel within the specified region) 

wherein E L £ E av £ E H ; E L and E H are constants which are defined taking into consideration the variable 
region of brightness in the case when the image to be processed is inputted. 
35 Furthermore, In the case when a plurality of specified regions exist, the average brightness of the specified 

regions is checked against the specified conditions for each region, and when the number of valid specified regions 
exceeds a certain threshold value, the image is judged to be valid. 
Step IN4: 

" r Is added to counter Fa. 
40 Step IN5: 

Fa is checked as to whether or not it has reached a specified value Fat; in the case when Fa has reached a 
specified value Fat, the procedure moves to step IN6. In the case when Fa has not reached this specified value, 
the procedure returns to step IN2. The value of constant Fat is designated according to the shortest number of 
cycles required for the inputted image to be stabilized. 
45 Step IN6: 

The image of image memory is designated (end of procedure IN). 

FIG. 5 is an outline showing the flow of procedure IN for designating an image by means of continuous rec- 
ognition of the Input and validity of the image. 

50 (2) image Modifying Means 

[0067] The properties of the image inputted from image input unit 2 to image processing unit 1 can be improved 
more effectively by using a smaller number of pixels in the processing over a range in which the recognition precision 
remains the same. For example, In the case when the number of pixels of the image memory is larger than the number 
55 of pixels to be processed (e.g., when the number of pixels of image memory 4 is 640 x 480 pixels (X = 0 ~ 639, Y = 
0 - 479), and the number of pixels to be processed is 256 x 240 pixels (X = 0 ~ 255, Y = 0 ~ 239)), after the image 
is Inputted into image memory 4, the range of the Image corresponding to the input Is checked, and a partial aggregation 
of the Image is extracted as a provisional image. Furthermore, from this provisional image, a small image corresponding 
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to the required number of pixels for processing is extracted, and this small image is then converted into a normal image 
for processing. An example of this Image modifying means is shown by procedure ET. 

(Image modifying procedure ET) 

5 

Step ET1 (Extraction of the small image in the X-direction): 

[0068] Steps ET1 a - ET1 d are executed. 

10 Step ET1 a (Determination of the X-coordinate of the left margin of the provisional image possessing a black pixel): 

[0069] Ka represents the increasing width in the X-direction (e.g., Ka = 1 ); the following process is conducted until 
the left margin of the provisional image is found wherein u = 0, Ka, 2Ka, 3Ka, ... (in order). 

[0070] The total value GA (u) of the brightness of the Y-coordinate (Y = 0, Ja, 2Ja, ... ) which is extracted in the Y- 
15 direction at the time when Y = u is calculated, and the value of u, at the time when the existence of a brightness 
corresponding to a black provisional image is initially confirmed, is designated as the X-coordinate of the left margin 
of the provisional image. For example, in the case when the image possesses only high brightness values in a state 
when there is no image input, and if Ja represents increasing width in the Y-direction (e.g., Ja = 1), the value of u at 
the time when it is confirmed that GA (u) < GA, is designated as the X-coordinate of the left margin of the provisional 
20 image (note: it is also possible to add the conditions of GA (u + Ka) < GA in order to further increase the reliability of 
the aforementioned). Constant GA is the threshold value indicating that a black provisional image is present at the 
time of binary conversion; the total brightness value of provisional extracted in the Y-direction is defined by taking into 
consideration the brightness value wherein this value approaches a minimum value at the time when black provisional 
images are incorporated. 

25 

Step ET1 b (Determination of the X-coordinate of the right margin of the provisional image possessing a black provisional 
image): 

[0071] The following process is conducted until the left margin of the provisional image is found wherein v = Xh, Xh 

30 - Ka, Xh - 2Ka, Xh - 3Ka, ... (in order). 

[0072] The total value GA (v) of the brightness of the Y-coordinate (Y = 0, Ja, 2Ja, ... ) which is extracted in the Y- 
direction at the time when X = v is calculated, and the value of v, at the time when the existence of a brightness 
corresponding to a black provisional image is initially confirmed, is designated as the X-coordinate of the right margin 
of the provisional image. For example, if Ja represents increasing width in the Y-direction (e.g., Ja = 1 ), the value of v 

35 at the time when it is confirmed that GA (v) < GA, is designated as the X-coordinate of the right margin of the provisional 
image (note: it is also possible to add the conditions of GA (v + Ka) < GA in order to further increase the reliability of 
the aforementioned). 

Step ET1c (Determination of Wx of the X-coordinate of the center point between the left and right margins of the 
40 provisional image): 

[0073] The Wx of the X-coordinate of the center point between the left and right margins of the provisional image is 
determined by the following formula. 

45 

Wx = (u + v)/2 

Step ET1d (Determination of the initial X-coordinate for extraction of the small image): 
so [0074] The initial X-coordinate Xa of the small image is determined by the following formula. 

Xa = Wx-XL/2 

ss [0075] XL represents the number of provisional In the X-direction of the small image. In order to standardize the size 
of the small image region, the following equations are formed: 

when 
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Xa < 0, Xa = 0; 

and 

5 when 



Xa + X1 - 1 > Xh, Xa = Xh - XL. 

10 Step ET2 (Extraction of the Y-directional range of the small image): 

[0076] In step ET2a ~ ET2d, the same processes as in step ET1 are conducted with regard to the Y-direction in 
order to calculate the Y-coordinate range of the small image. 

is Step ET2a (Determination of the Y-coordinate of the upper margin of the provisional image possessing a biack 
provisional image): 

[0077] Kb represents increasing width in the Y-direction (e.g., Kb = 1); the following process is conducted until the 
upper margin of the provisional image is found wherein u = 0, Kb, 2Kb, 3Kb,... (in order). 

20 [0078] The total value GB (u) of the brightness of the X-coordinate (Y = 0, Jb, 2Jb, ...) which is extracted in the X- 
direction at the time when Y = u is calculated, and the value of u, at the time when the existence of a brightness 
corresponding to a black provisional image is initially confirmed, is designated as the Y-coordinate of the upper margin 
of the provisional image. For example, in the case when the image possesses only high brightness values in a state 
when there is no image input, and if Jb represents increasing width in the Y-direction (e.g., Ja = 1), the value of u at 

25 the time when it is confirmed that GB (u) < GB, is designated as the Y-coordinate of the upper margin of the provisional 
image (note: it is also possible to add the conditions of GB (u + Kb) < GB in order to further increase the reliability of 
the aforementioned). Constant GB is the threshold value indicating that a black provisional image is present at the 
time of binary conversion; the total value of the brightness values of provisional image extracted in the X-direction is 
defined by taking into consideration the brightness values wherein this value approaches a minimum value at the time 

30 when black provisional are incorporated. 

Step ET2b (Determination of the Y-coordinate of the lower margin of the provisional image possessing a black 
provisional image): 

35 [0079] The following process is conducted until the left margin of the provisional image is found wherein v = Yh, Yh 
- Kb, Yh - 2Kb, Yh - 3Kb, ... (in order). 

[0080] The total value GB (v) of the brightness of the X-coordinate (X = 0, Jb, 2Jb, ...) which is extracted in the X- 
direction at the time when Y = v is calculated, and the value of v, at the time when the existence of a brightness 
corresponding to a black provisional image is initially confirmed, is designated as the Y-coordinate of the lower margin 
40 of the provisional image. For example, if Jb represents increasing width in the Y-direction (e.g., Ja = 1 ), the value of v 
at the time when it is confirmed that GB (v) < GB, is designated as the Y-coordinate of the lower margin of the provisional 
image (note: it is also possible to add the conditions of GB (v - Kb) < GB in order to further increase the reliability of 
the aforementioned). 

45 Step ET2c (Determination of Wy of the Y-coordinate of the center point between the upper and lower margins of the 
provisional image): 

[0081] The Wy of the Y-coordinate of the center point between the upper and lower margins of the provisional image 
is determined by the following formula. 

50 

Wy = (u + v)/2 

Step ET2d (Determination of the initial Y-coordinate for extraction of the small image): 

55 

[0082] The initial Y-coordinate Yb of the small image is determined by the following formula. 
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Yb = Wy-YL/2 

[0083] YL represents the number of pixels in the Y-direction of the small image. In order to standardize the size of 
5 the small image region, the following equations are formed: 
when Yb < 0, Yb = 0; and 
when Yb + YL - 1 > Yh, Yb = Yh - YL. 

Step ET3 (Extraction of the pixels to be processed): 
10 ™" " 

[0084] The range defined by X = Xa ~~ Xa + XL - 1 , and Y = Yb ~ Yb + YL - 1 is then converted into a small image 
for processing. 

Step ET4 (Conversion of the small image into a normal image): 

[0085] The conversion for converting the range of the small image into a normal image is performed as necessary; 
e.g., conversion of the designation of the origin, designated location of the image, etc. (End of Procedure ET) 
[0086] FIG. 6 is a diagram for use in explaining the conversion of the processing range of an image; this figure shows 
examples of the image: designated by image memory, provisional Image and small image. Furthermore, it is also 
20 possible to execute procedure ET in only the X-direction or the Y-direction; in this case, the direction in which procedure 
ET is not being performed serves as a fixed range. In the case when the image of image memory is used as the image 
for processing, conversion by means of procedure ET is unnecessary. 

(3) Smoothing Means 

25 

[0087] Smoothing is a process for reducing the noise of a fingerprint image. As this smoothing process, any conven- 
tional method may be employed (e.g., use of a local summation averaging filter which utilizes the values of neighboring 
pixels around each pixel). 

[0088] In the case when a binary image can be directly inputted into image memory 4, smoothing may be omitted. 
30 a gray-scale image results from the smoothing of a binary image, thus it is necessary to conduct binary conversion of 
this image after smoothing. 

(4) Binary Conversion and Background Segregation Means: 

35 [0089] Binary conversion is a process forconverting a gray-scale Image into a binary image. Background segregation 
is a process for clarifying the valid range of a fingerprint image of image 10 in image memory 4. In the following, 
procedure B will be presented as an example of a procedure for conducting binary conversion and background sepa- 
ration. The input information is the input image information. The output information of procedure B is the binary image 
of the output image and the fingerprint boundary information. In the case when utilizing an image input unit which can 

^0 directly input the binary image into image memory 4, binary conversion (step B1) is omitted, and only background 
segregation is performed. Similarly, in the case when only binary conversion is required, i.e., background segregation 
is unnecessary, it is possible to only perform step B1 . 

(Procedure B) 

45 

[0090] K is defined as a constant Indicating the X-directional length of a partial region. The Y-directional length of a 
partial region may differ from the X-directional length of the partial region, however, for the sake of convenience, the 
case in which these lengths are equal will be presented in the following. In addition, L Is defined as follows: 

L=(X h + iyK 

In the formula, K is selected to produce an integer L. In general, it is possible to vary the length of each partial region. 

Km«=«Xh+iyK)-1 

With regard to image 1 0, the partial region addresses, which uniquely and clearly discriminate each partial region, are 
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designated as initial pixel addresses for each partial region. A random pixel address (X,Y), at partial region address J 
(M,N), is M =[X/K] t and N =[Y/K]. Accordingly, pixel address (X,Y) corresponding to partial region address J(M, N) is 
obtained by, performing the following calculations: 

X = K*M, (1^=0,1,2,...,^) 
Y = K» N, (N=0,1,2,...,K max ) 



to 



Step B1 (binary conversion): 
Step B1a : 

15 [0091] Processing is performed with regard to the following: 

M- 0,1,2, K„ 



20 



25 



35 



40 



45 



N-0.1,2 K^ 

The average brightness B av (M, N) of all of the pixels within each partial region is obtained for each partial region J(M, 
N) using the following equation: 

Bav(M, N)= (the sum of the brightness values of the pixels within a partial 
region) / (the number of pixels within the partial region) 

At this point, (M, N) of 

X = K«M(M = 0~K max ) 

Y = K.N(N = 0~K max ) 
corresponds to the range of image 10. In other words, when the range of the image are 

o <, x <; Xh 

0 £ Y £ Yh 



the corresponding range becomes 
50 M = 0 ~ [Xh/K] 

N = 0 - [Yh/K] 

55 and, 

total number of partial regions in image 10 = ([Xh/K] + 1) • ([Yh/K] + 1). 
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In addition, the average brightness of the entire image is obtained as follows. 

Average brightness of the entire image = 
(Sum of brightness values of the entire image) / (Total number of pixels in the entire Image). 

Step Bib : 

[0092] In order to reduce the non-continuity generated by the boundaries of the partial regions, the following modi- 
fications are carried out when 



M=1 ~([Xh/K]-1) 



N=1 ~([Yh/K)-1) ( then 



Cav(M, N) = (AO ♦ Bav(M, N) + A1 ♦ Bav(M+1 , N) + A2 • 
Bav(M+1 , N-1 ) + A3 • Bav(M, N-1 ) + A4 • Bav(M-1 , N-1 ) + A5 • 
Bav(M-1 , N) + A6 • Bav(M-1 , N+1 ) + A7 • Bav(M, N+1) + A8 • 
Bav(M+1, N+1))/ (AO + A1 + A2 + A3 + A4 + A5 + A6 + A7 + A8). 

AO, A1 , A2, A3, A4, A5, A6, A7 and A8 are constants which are determined by taking into consideration the reciprocal 
relationships between partial regions. For example, it is possible to set the following: 

AO = A1 » A2 = A3 = A4 * A5 = A6 = A7 = A8 = 1 The Cav(M, N) of each (M, N) is then stored in the working 
area of memory. 

[0093] Subsequently, it is also possible to change the average brightness Bav(M, N) of each partial region according 
to the reciprocal relationships between the partial regions (M, N) by means of setting Bav(M, N) = Cav(M, N) for 

M = 1 ~([Xh/Kl-1)andN = 1 ~([Yh/K]-1). 

[0094] FIG. 7 shows an example of the relationship between a partial region (M, N) and the average brightness Bav 
(M, N) of this partial region. The method for modifying the average brightness of the partial regions according to the 
reciprocal relationships of the partial regions is not limited to just the aforementioned processes. For example, it is 
possible to increase or decrease the number of partial regions, as well as change the formula of the above-mentioned 
Cav(M, N) using the reciprocal relationships. 

Step B1c : 

[0095] (a) The threshold value T with regard to the brightness f(X,Y) of pixel (X,Y) of the partial region for which B av 
(X,Y) was calculated with respect to each partial region is set as follows: 

T= average value of brightness of a partial region + D + Da 

wherein D is a constant for correcting the average brightness value of the partial region. Da is a variable (e.g., initially, 
Da = 0) which will be explained hereafter. 

[0096] When f(X,Y) * T, (X, Y) for this partial region (M,N), i.e., the (X,Y) of the region defined by 

K»M£X£K»(M + 1)-1 
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K»Ns y<;k»(n + 1)-i 

designates white pixels (however, when reversing the pixels, (X,Y) designates black pixels); while, on the other hand, 
5 when f(X,Y) < T, the (X,Y) designates black pixels (when reversing the pixels, (X,Y) is set to white pixels). 

[0097] As described in the aforementioned, a binary conversion process is provided in which the average brightness 
values of the partial regions serve as essential components of the threshold value. 

[0098] When a large number of pixels with high brightness values exist within a partial region, and when the average 
brightness values of partial regions in which little brightness variation occurs are high, a large number of pixels within 
io a given partial region will be converted to black pixels as a result of binary conversion. In order to prevent this afore- 
mentioned result, partial regions possessing a high average brightness, in which there is little brightness variation, 
undergo binary conversion using a specified threshold value which is previously defined, rather than employing the 
aforementioned binary conversion threshold value. In the following, a concrete procedure for performing the aforemen- 
tioned will be explained. 

is [0099] At every partial region of the original image (gray-scale image), when B av (* •) < B m , the above-described 
binary conversion in which the average brightness serves as the threshold value is employed. 
[0100] However, when B^*, •) £ B m , 

(B m is a value for judging whether or not the average brightness is a high value; e.g., in the case when a brightness 
of 180 - 255 is regarded as high, B m = 180) the following calculation is performed for each pixel within one random 
20 partial region: 

G = ((average brightness of the partial region) - (brightness of each pixel within the partial region)l 

25 [0101] The maximum value G max of these values of G is then calculated, and in the case when G max < B sman (B 5maII 
represents the upper limit of change in the range of the brightness; e.g., in the case when change of brightness ranges 
from 0 - 10, a minute variation in brightness may be indicated by B^, = 10), the pixels of the above partial region 
are regarded as showing little variation in brightness, and hence this partial region undergoes binary conversion using 
a specified binary conversion threshold value T = B g (e.g., B g represents the average brightness of the entire image 

30 or a fixed value). 

[01 02] This procedure is repeated for all partial regions of the original image. FIG. 8 is a flowchart showing an outline 
example of the binary conversion process performed on partial regions in which there is little brightness variation. 
[0103] In the following process, the brightness states of the image differ depending on the conditions at the time of 
image input. Therefore, the ratio of black pixels of the partial region to total pixels is first calculated, and when this 
35 value falls outside of a specified range, the value of Da is modified, and binary conversion is repeated a specified 
number of times (at least once). The procedure for optimizing the threshold value of the binary conversion will be 
presented in the following. 

[0104] The ratio of black pixels in all valid partial regions Rt, w is calculated as follows: 

40 

R bw = (Number of black pixels in all partial regions) / (T otal number of pixels in ait partial regions) 

[0105] When l\ w1 £ 5 f\ w2 , the ratio of black pixels is normal, and binary conversion can then be completed. 
However, when > R^, Tis reduced in order to decrease the number of black pixels. In other words, D a is replaced 
45 by (D a - D a1 ). When R bw < R bw1 , T is increased In order to increase the number of black pixels, i.e., O a is replaced with 
(D a + D al ). 

[0106] Rb w1 and R^ are constants for standardizing the ratio of black pixels: e.g., when a black pixel ratio of 40 ~ 
45% is desired, f\ w1 and R^ are set to 0.40 and 0.45, respectively. D a1 is a constant for increasing/decreasing the 
threshold value of the binary conversion (e.g., D a1 = 1). When the ratio of black pixels is calculated using binary con- 
50 version, and this ratio falls outside of a specified range, the threshold value T of the binary conversion is modified, and 
the binary conversion process is repeated a specified number of times. When the ratio of black pixels remains outside 
of a specified range even after repeating the binary conversion process a specified number of times, the procedure 
may be abandoned, for example, and then restarted from the input of the image. 

[0107] D a1 may reduce the processing time in order to allow for the ratio of black pixels to fall within a specified 
55 range, and may also utilize a plurality of different values in order to Increase the probability of the ratio of black pixels 
falling within a specified range. With regard to the binary image divided into partial regions, FIGS 9A and 9B show an 
example of the process for standardizing the ratio of binary converted black pixels. The constant group consisting of 
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D aL and (e.g., D a1 = 3, = 2, and = 1 ) is used for modifying D a . (i = 1 , 2, ...) can be structured using 
an optional number of constants. By means of designating an appropriate number of constant groups and values, the 
possibility and convergence speed of converging the value of to within a specified range can be improved. Fur- 
thermore, in FIG. 9A and 9B A 1pi A 1pi A^, A 1m , A^ and A3 m are parameters which change dynamically during the 
5 processing in order to select the procedures involved. 

Step B2 (Indication of a valid partial region): 

[0108] The average brightness of the partial region is then re-calculated with respect to the binary image obtained 
10 as a result of step B1 . Next, for 

Partial region address l MN = ([X/K],[Y/K]) 
15 [0109] (The partial region address is the initial address of each partial region) 

X = K*M,(M= 0,1,2, ...K max ) 



Y = K.N,(N=0 t 1,2,...K max ) 

a judgment of "valid" or "invalid" is rendered for each partial region according to the average brightness value B av (X, 
Y) calculated from the process for calculating the average brightness for each partial region. In other words, in a partial 
25 region where BL ^ B^X, Y) £ B H , this partial region is judged to be a valid partial region, and valid indicator is designated 
in partial region table Y(M,N). 

Y(M,N) = {1 : Valid partial region. 0: Invalid partial region) 
[0110] B L and B H are constants for classifying valid and invalid partial regions. 

30 Step B3 (Examination of the number of valid partial regions) 

[0111] From Y(M,N), 

YT = number of valid partial regions 
is counted. When YT £ YC (e.g., YC = the total number of partial regions x threshold ratio constant), the procedure 
35 moves to step B4. When YT < YC, the a shortage in the number of valid partial regions has occurred, and hence 
present procedure ends due to an error. 

Step B4 (Left margin of the fingerprint boundary of a partial region unit): 

40 [0112] The information of the fingerprint boundaries of a partial region is represented by {(N T , M L , M R ), N T = 0 — 
K^}. For each N = N T value, M L £ M £ M R is the fingerprint area of the partial region unit. 

[01 13] In this step, the left margin M L of the fingerprint boundary is calculated for the each partial region unit. Starting 
from N=0, the following process is carried out for N=N T , (N T = 0 - K^). Beginning from the left margin (M=0) and 
continuing in the direction of increasing M, a search is sequentially conducted for elements G(M,N) possessing an 

45 indicator of "1 ■ (indicating an valid partial region) in table G, which shows the valid partial regions. The value M L of the 
initial M of a section in which indicators having a "1" value are continuous for Kc (Kc is a constant > 1 for judging the 
fingerprint boundaries of the partial region) indicators or more is set as the left margin of the fingerprint area. At M = 
0 ~ Kmax- when indicators having a value of "1 " (indicating a valid partial region) are not found to be continuous for Kc 
indicators or more, the value of the current N is the non fingerprint area for all M. Additionally, at N T of the non fingerprint 

50 area, 

M L = M R = -1. 

55 StepB5 (Right margin of the fingerprint boundary for each partial region): 

[0114] In this step, the right margin M R of the fingerprint boundary is calculated for each partial region unit. Starting 
from N = 0, for N = N T (N T = 0 - K^), any N for which the left margin was not set In step B4 (i.e., N when M L = -1 ) Is 
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skipped. Beginning from the left margin (I^K^) and continuing in the direction of decreasing M, a search is sequen- 
tially conducted for elements G(M.N) which are indicated by "1" (indicating an valid partial region). The value M R of 
the initial M of a section in which Indicators having a value of "1 " are continuous for Kc (Kc is a predetermined number) 
or more indicators is set as the right margin of the fingerprint area for the current N. From the preceding, the partial 
region fingerprint boundary information {(N T , M L , M R ), N T = 0 - K^} is calculated. 

Step B6 (Fingerprint boundary information of each pixel) 

[01 1 5] The fingerprint boundary information of each pixel is calculated from the fingerprint boundary information {(N T , 
M L , M R ), NT = 0 ~ K max } for each partial region. The fingerprint boundary information of each pixel is shown by {(Y T , 
x l» x r). y t = 0 - ( Yn * 1 ))• For e ach value of Y T , \ £ X s X R is the fingerprint area. 

[01 16] According to the fingerprint boundary information of the partial region, in N = 0 ~ K^, with regard to Y = Y T 
ofKxN^YsKxN + K^, the fingerprint boundary information {(Y T> X L , X R ), Y T = 0 - (Yh - 1)} of each pixel is 
calculated wherein: 

X L = K • M L 



X R = K • M R + K max 

(End of procedure B) 

[0117] FIG. 10 is an example of a table showing the valid partial regions of a fingerprint. From this point on, for the 
sake of simplicity, the term "fingerprint boundary information" wiil indicate the fingerprint boundary information {(Y T , 
X L , X R ), Y T = 0 - (Yh - 1)} of each pixel. In addition, with regard to background segregation, it is possible to simply 
process the entire image as the fingerprint region in place of steps B4 - B6. 

(5) Means for calculating an approximate center point 

[01 18] With regard to the approximate center point of the fingerprint image, a means is provided for calculating the 
center point ([Xh/2], [Yh/2]) of image 1 0 or an approximate center point (Xc, Y c ) from among neighboring points. In 
addition, it is also possible to optionally use a conventional means for calculating the approximate center point. 

(6) Thinning Means 

[01 19] Thinning is a process for setting the majority of a line width of an image to one pixel. It is possible to optionally 
use any thinning method (e.g., conventional thinning methods mentioned before) as the thinning means. 

(7) Narrowing Process 

[0120] The narrowing process maintains the majority of the line widths of an image to a specified line width or less. 
This narrowing process is basically achieved by means of standardizing the ratio of black pixels to total pixels (optionally, 
the ratio of white pixels to total pixels or ratio of black pixels to white pixels) in the binary conversion process, hence 
this is considered an aspect of the narrowing process as well. Furthermore, the following methods can be used to 
narrow the line width of a binary image. 

[0121] Aggregations of one or more black pixels are treated as the lines of an image. The method of maintaining the 
designated line width value is optional, as it is possible to maintain a designated value as input information of the 
narrowing process and/or maintain this value within the narrowing process. It is also possible to maintain one or more 
designated line width values within a single narrowing process. In the preferred embodiments of the present invention, 
the procedure of narrowing can be appropriately used in response to the designated line width value. An example of 
a narrowing process which depends on the designated line width value is presented below. 

(a) Narrowing process for setting the majority of line widths to one pixel (Designated line width value is one pixel) 

It Is possible to use a conventional method (i.e., a thinning method which can set the majority of the line widths 
to the width of one pixel) as a procedure for narrowing the line width of a binary Image (or a procedure for binary 
converting a gray-scale image and nan-owing the line width therein). Furthermore, other methods also exist for 
directly performing binary conversion and narrowing of a gray-scale image. 

(b) Narrowing process for narrowing the majority of lines to a width below a designated line width (Designated line 
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width value is a random integer) 

[0122] This process may aiso be realized using a conventional method. For example, a method such as the following 
is available. 

5 

I) In the case when a narrowing process, in which the process of removing the components of a line, one pixel at 
a time, is repeated from the outer side of a line forming an image (in the preferred embodiments of the present 
invention, this corresponds to the black pixels which represent the fingerprint lines) until the majority of the line 
widths are modified to one pixel, it Is possible to set the repetition number In the narrowing process as follows: 

10 

Repetition number = {(Maximum line width of original binary image)-(designated line 
width va!ue)}/(Approximate number of pixels to be deleted from 

15 

each line width using a single image plane treatment process) 

ii) Narrowing method in which black pixels are kept in the center of the line components forming an image 

20 [0123] With regard to the black pixels on the line segment of a section where an random straight line and the line of 
an image intersect, narrowing can be accomplished by means of keeping black pixels below a designated line width 
value including the center point of said line segment (in the case when the line segment width exceeds the designated 
line width value, the center point of the line segment is set as the center and the black pixels of the designated line 
width value are kept; all black pixels on the line segment which does not satisfy the designated line width value are kept) . 

25 [0124] In the preferred embodiments of the present invention, when performing the narrowing process on a registered 
fingerprint image and a test fingerprint image, the designated line width value may be randomly set. However, it is 
necessary to define this value on the basis of such factors as the quality and characteristics of the input image, the 
performance with respect to the designated line width value in the narrowing process, the performance required by 
image processing device 1 , and the like. If the difference between the designated line width values in the narrow 

30 processing of a registered fingerprint and a test fingerprint, respectively, is large, the errors in aligning both images 
becomes considerable. If this aforementioned difference becomes too large, a decrease in the accuracy of the com- 
parison sometimes occurs. Providing a smaller line width for the modified image of a registered fingerprint allows for 
a reduction in the amount of memory required for registered information due to a decrease in the number of pixels. 
Taking the aforementioned into consideration, either of the following designations will be effective. 

35 

(a) In the narrowing process of a registered fingerprint image, the designated line width value is set to one pixel; 
in the narrowing process of a test fingerprint, the designated line width value is appropriately set to a value of at 
least two pixels. 

(b) The designated line width values are appropriately selected according to the conditions wherein the designated 
40 line width value for the nan-owing process of a registered fingerprint is set to a value smaller than the designated 

line width value of the test fingerprint. 

(c) In the processing of a registered fingerprint image, the designated line width value is set to one pixel; in the 
narrow processing of a test fingerprint, the designated line width value is appropriately adjusted according to the 
ratio of black pixels at the time of binary conversion (this case is presented in the following embodiment). 

45 

(8) Process for recording the registered information of a registered image 

[0125] The process of recording fingerprint information involves extracting sub-template RT(0) and non-sub-template 
RB(0) from the modified image Rth of the registered fingerprint in image 10, which results from inputting a registered 

so fingerprint into image 10 of image memory 4 and then performing the above narrowing process, and then storing the 
aforementioned sub-template RT(0) and non-sub-template RB(0) in respective file memory. The procedure for per- 
forming this recording process of the fingerprint information is illustrated by procedure R. The input information of 
procedure R is the file name of the sub-template and non-sub-template of the registered fingerprint, the modified Image 
Rth of the registered fingerprint, the fingerprint boundary information of the registered fingerprint and the approximate 

55 center point of the registered fingerprint (Xrc.Yrc). The output information of procedure R is the file of the sub-template 
RT(0) and the file of the non-sub-template RB(0). 
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(Procedure R) 

Step R1 (Formation of sub-template RT(0)): 

5 [0126] Black pixel addresses within the fingerprint area and within the range of sub-template RT(0) are extracted 
from modified Image Rth of the registered fingerprint to form the file of sub-template RT(0). In the storage file of RT 
(0), the approximate center point of the registered fingerprint (X^.Yrc) is also stored. 

Step R2 (Formation of non-sub-template RB(0)): 

10 

[0127] A black pixel address which is outside sub-template RT(0) and within fingerprint area FA is extracted from 
modified image Rth of the registered fingerprint to form the file of non-sub-template RB(0). 

[01 28] Furthermore, storage format of each file of the sub-template and non- sub-template is optional. For example, 
data may be compressed and stored in a file, and, at the time of utilization, data elongation may be performed. 

15 

Step R3 

Step R3a (Formation of a file RSa of a sweat gland hole) 

20 [0129] This step is executed in the case when optionally selecting to check a sweat gland hole. In a previously 
determined region of a registered fingerprint, a specified number of addresses corresponding to holes (holes formed 
by white pixel aggregations in a binary image wherein ridge lines are represented by black pixels) formed from sweat 
glands exceeding a predetermined size are calculated by using means for a hole search, and the central address 
among these addresses is recorded in the file of a sweat gland hole. 

25 

Step R3b (Formation of a file RSb of a sweat gland non-hole) 

[0130] This step is executed in the case when optionally selecting to check a sweat gland non-hole.. In a previously 
determined region of a registered fingerprint, a specified number of addresses, corresponding to areas in which sweat 
30 glands exceeding a predetermined size do not exist, are calculated by means of a non-hole searching means, and the 
central address among these addresses is recorded in the file of a sweat gland non-hole. 
(End of procedure R) 

(9) Hole Search Means (Procedure WH) 

35 

[0131] An example of a hole is shown in FIG. 11 (a). It is possible to detect the aforementioned hole by means of 
the following procedure WH. (Procedure WH) 

Step WH1 : 

40 

[0132] In searching for a hole In the image, prospective addresses are sequentially examined, and a random white 
pixel address A Is selected. With regard to this prospective address, it is possible, for example, to select all of the 
pixels, pixels separated by an interval of n pixels (n = 2, 3, 4, etc.), and the like. 

<5 Step WH2 : 

[0133] The pixels connected around the neighborhood of the white pixels of address A are checked in order to 
determine whether or not a white pixel aggregation AA, in which a specified number of pixels are connected, exists. 
In the case when this white pixel aggregation AA does not exist, the process is re-executed from the beginning of 
so procedure WH, while in the case when this white pixel aggregation AA exists, the procedure moves to step WH3. 

Step WH3 : 

[0134] In this step, a check is conducted as to whether or not the white pixel aggregation AA is surrounded by a 
55 group of connected black pixels. In the case when a series of connected black pixels do not surround white pixel 
aggregation AA, the process is re-executed from the beginning of procedure WH. In the case when white pixel aggre- 
gation AA is surrounded by a group of connected black pixels, white pixel address A is recognized as the address of 
a hole. 
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Step WH4 : 

[0135] The present procedure WH is then repeated on alt prospective addresses to be searched. 
(End of procedure WH) 

5 

(10) Non-Hole Search Means (Procedure NWH) 

[0136] An example of a non-hole is shown in FIG. 11 B. It is possible to detect the aforementioned non-hole by means 
of the following procedure NWH. 

10 

(Procedure NWH) 
Step NWH1 : 

is [0137] In searching for a non-hole in the image, prospective addresses are sequentially examined, and a random 
black pixel address B is selected. With regard to this prospective address, it is possible, for example, to select all of 
the pixels, pixels separated by an interval of n pixels (n = 2, 3, 4, etc.), and the like. 

Step NWH2 : 

20 

[01 38] The pixels connected around the periphery of the black pixels of address B are checked in order to determine 
whether or not a black pixel aggregation BB, in which a specified number of pixels are connected, exists. In the case 
when this black pixel aggregation BB does not exist, the process is re-executed from the beginning of procedure NWH. 
In the case when this black pixel aggregation BB exists, black pixel address B is recognized as the address of a non- 
25 hole. 

Step NWH3 : 

[0139] The present procedure NWH is then repeated on ail prospective addresses to be searched. 
30 (End of procedure NWH) 

(11) Image Data Recording Means 

[0140] When storing the address of each black pixel (X,Y) as originally presented in a file, the memory capacity 
35 required is as follows: 

Memory Capacity = (Number of black pixels) • [(Unit memory capacity of X- 
40 coordinate) + (Unit memory capacity of Y-coordinate)] 

[0141] It is necessary to store information regarding the sub-template and the non-sub-template, respectively, in the 
files of a registered fingerprint image. In order to reduce the amount of storage data to less than when black pixel 
addresses of a binary image are recorded in their original states, the data is compressed and recorded In a file without 
45 an increase in the processing amount. The following process Is an example of the aforementioned. 

[0142] The following case is for a 4 x 4 pixel aggregation. A 4 x 4 pixel aggregation is shown in FIG. 3 for optional 
representative pixel P 0 . The black and white classification of each pixel is shown by bits. With regard to P 0 - P 15 , the 
black pixel and white pixel states of each neighboring pixel can be shown by means of the 2 byte pixel aggregation 
code Q (0000-FFFF by hexadecimal digits), in accordance with the following: 

50 

Q=P 15 IIP 14 IIP 1 3ll...llP 7 IIP 6 IIP 5 IIP 4 IIP 3 IIP 2 HP 1 IIP 0 

The pixel address (X,Y) shown in FIG. 3 (b) which is determined by means of the representative pixel P 0 =(Xo. Y o) and 
55 the relative position therein, is expressed as follows: 

P t : X=X 0 -1 Y=Y 0 



20 



EP 0623 890 B1 



X=X 0 -2 Y=Y„ 



10 



15 



20 



25 



30 



35 



40 



P 3 : X=X 0 -3, Y=Y 0 



P 4 : X=X 0l Y=Y 0 -1 
P 5 : X=X 0 -1, Y=Y 0 -1 



P 6 : X=X 0 -2, Y=Y 0 -1 



P 7 : X=X 0 -3, Y=Y 0 -1 



P 8 : X=X 0 , Y=Y 0 -2 

P 9 : X=X 0 -1, Y=Y 0 -2 

P 10 : X=X 0 -2, Y=Y 0 -2 

P„: X=X 0 -3, Y=Y 0 -2 

P 12 : X= Xq, Y= Yq - 3 

P i3 : X=X 0 -1, Y=Y 0 -3 

P u : X=X 0 -2, Y=Y 0 -3 

Pis- X=X 0 -3, Y=Y 0 -3 



The compression processing of the registered fingerprint image data involves converting the (X,Y) coordinate of the 
registered fingerprint image data (X= 0~Xh, Y= O-Yh) to the following form. With regard to the area within the valid 
45 region of a fingerprint, each fourth X-coordinate is set to each fourth Y-coordinate as the representative pixel, after 
which the range of the 4 x 4 pixel aggregation is checked to determine whether or not any black pixels exist. The X- 
coordinate of the representative pixel and the pixel aggregation code are only stored in the case when black pixels are 
present. 

[0143] In order to designate the portion of the X-address at four pixel intervals, the lower two bits may be used as 
so format identification data of the pixel aggregation. In this manner, when half (lower half, upper half or left half) of the 
pixel aggregation code is represented by white pixels, a partial pixel aggregation is expressed by one byte of the 
remaining half of the pixel aggregation code (in accordance with the above-mentioned order, upper half, lower half, or 
right half). 



55 (a) When the format identification data of the pixel aggregation is expressed by a bit indicator of "11", the pixel 

aggregation code is expressed by two bytes (i.e., P 15 II P 14 II... IIP t II P 0 ). 

(b) When the format identification data of the pixel aggregation is expressed by a bit indicator of MO", the pixel 
aggregation code Is expressed by one byte of the upper half (i.e., P 15 II P 14 II P 13 II P 12 II P^ II P 10 II P g II P 8 ). 
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(c) When the format identification data of the pixel aggregation is expressed by a bit indicator of "01 ", the pixel 
aggregation code is expressed by one byte of the lower half (i.e., P 7 II P 6 II P 5 II P 4 II P 3 II P 2 II P 1 1| p 0 ), 

(d) When the format identification data of the pixel aggregation is expressed by a bit indicator of "00" , the pixel 
aggregation code is expressed by one byte of the right half (e.g., P 13 II P 12 II P 9 II P 8 II P 5 1 1 P 4 II II P 0 ). 

5 

[0144] When the pixel aggregation code is expressed by 1 byte, the omitted pixels are all white pixels. In the case 
when the pixel aggregation code is expressed by 1 byte, conversion of the X-address portion, incorporating two bits 
for use in the format identification data of the pixel aggregation, into a pure X-address is possible by means of setting 
the bit portion for use in the format identification data flag of the pixel aggregation to "0". 

io [0145] In other words, at the time of compression, the (X,Y) coordinates of the image data (i.e., X= 0~Xh, Y= O-Yh) 
is converted to the following form. Each fourth X-coordinate is set to each fourth Y-coordinate as the representative 
pixel, after which the range of the 4 x 4 pixel aggregation is checked to determine whether or not any black pixels exist. 
The X-coordinate of the representative pixel and the pixel aggregation code are only stored in the case when black 
pixels are present. An example of the process for recording the binary image at this time is illustrated by procedure G 

is below. 

(Procedure G) 
StepGI : 

[0146] Based on the X-address portion, 4x4 pixel aggregations are sequentially selected. All of the pixels (P 15 ~P 0 ) 
are then checked to determine whether or not these pixels are all white pixels. When all of the pixels are white pixels, 
the current 4x4 pixel aggregation is skipped, and step G1 is conducted on the subsequent 4x4 pixel aggregation 
from the beginning. When all of the pixels are not white pixels, the procedure moves to step G2. 

25 

Step G2 : 

[0147] The upper half of the pixel aggregation (P 15 ~P e ) is then checked to determine whether or not these pixels 
are all white pixels. When all of the pixels are not white pixels, the procedure moves to step G3. When the upper half 
30 contains all white pixels, the lower half of the pixel aggregation (P 7 ~P 0 ) is expressed by a pixel aggregation code of 
1 byte. The lower two bits of the X-address portion are then set to a bit pattern of "01 u . 

Step G3 : 

35 [0148] The lower half of the pixel aggregation (P 7 -P 0 ) is then checked to determine whether or not these pixels are 
all white pixels. When all of the pixels are not white pixels, the procedure moves to step G4. When the lower half 
contains all white pixels, the upper half of the pixel aggregation (P 15 ~P 8 ) is expressed by a pixel aggregation code of 
1 byte. The lower two bits of the X-address portion are then set to a bit pattern of "10". 

40 Step G4 : 

[0149] The left half of the pixel aggregation (P 15 , P 14l P^ , P 10 , P 7 , P 6 , P 3 , P 2 ) is then checked to determine whether 
or not these pixels are all white pixels. When all of the pixels are not white pixels, the procedure moves to step G5. 
When the left half contains all white pixels, the right half of the pixel aggregation (P 13 II P 12 II P 9 II P 8 II P 5 II P 4 II Pi II 
*5 p 0 ) is expressed by a pixel aggregation code of 1 byte. The lower two bits of the X-address portion are then set to a 
bit pattern of "00". 

Step G5 : 

so [0150] In this step, the 4 x 4 pixel aggregation is expressed by a pixel aggregation code of 2 bytes. The lower two 
bits of the X-address portion are then left in their original form (i.e., bit pattern of "11 "). 

Step G6 : 

55 [0151] The processing of this pixel aggregation code and X-address is then completed. 
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Step G7 : 

[0152] Steps G1 ~ G6 are then repeated with respect to all 4 x 4 pixel aggregations for each X-address. 
5 Step G8 ; 

[0153] In this step, the binary image is recorded by setting the file storage format as follows: 
Y-coordinate = Ys, number of groups In stored X-address portion, 

{(X-address portion of representative pixel As (including 2 bits of the format identification data of the pixel aggre- 
10 gation), Pixel aggregation code), (X-address portion of representative pixel Bs (including 2 bits of the format identifi- 
cation data of the pixel aggregation), Pixel aggregation code), . . .} 



Y= 3 + 4j, number of groups In stored X-address portion, 

{(X-address portion of representative pixel Aj (including 2 bits of the format identification data of the pixel aggre- 
15 gation), Pixel aggregation code), (X-address portion of representative pixel Bj (including 2 bits of the format identification 
data of the pixel aggregation), Pixel aggregation code), . . .} 



Y= Ye: number of groups in stored X-address portion, 

{(X-address portion of representative pixel Ah (including 2 bits of the format identification data of the pixel ag- 
20 gregation), Pixel aggregation code), (X-address portion of representative pixel Bh (including 2 bits of the format iden- 
tification data of the pixel aggregation), Pixel aggregation code),.,.}, {termination indictor) 
(End of Procedure G) 

[0154] The number of groups of the stored X-address portion indicates the number of pixel aggregation codes cor- 
responding to the Y-coordinate at the time to be stored. The number of groups of the stored X-address portion are 

25 determined without designating a Y-coordinate of "0". In addition, 4x4 pixel aggregations which contain only white 
pixels are not recorded. The pixel aggregation codes may be expressed by either 1 byte or 2 bytes, and are classified 
by the lower two bits of the X-address portion. Furthermore, it is also possible to add groups of termination signals (e. 
g., of the X-address portion of the representative pixel and pixel aggregation code) at each Y-coordinate value in place 
of the groups of the stored X-address portion. 

30 [0155] FIG. 12A show an example of the case when the image memory is divided into small regions of 4 x 4 pixel 
aggregations. FIG. 12B shows an example of the upper half of a 4 x 4 pixel aggregation. FIG. 12C shows an example 
of the lower half of a 4 x 4 pixel aggregation. FIG. 1 2D shows an example of the right half of a 4 x 4 pixel aggregation. 
Furthermore, in the aforementioned, the case in which the image memory is divided into small regions of 4 x 4 pixel 
aggregations is presented, however, it is possible to optionally designate both the size of the small regions and the 

35 method of division within the small regions. 

[0156] In addition, in order to return the format of the binary image data compressed in procedure G back to its 
original (X,Y) form, It is sufficient to simply reverse the sequence of procedure G. 

(12) Means for Comparing a Registered Image and Test Image 

40 

[01 57] Comparison process is a process for checking the concordance of each black pixel of a black pixel aggregation 
In a modified image of a test fingerprint, with each black pixel in a black pixel aggregation which has been stored in 
memory 6 as registered information relating to the modified image of a registered fingerprint. 
[0158] Coordinate conversion by means of rotational and parallel displacement In order to align a registered finger- 
45 print and a test fingerprint, can be carried out for either image. However, in the preferred embodiments herein, the 
modified image of the registered fingerprint is displaced to align it with the modified image of the test fingerprint, since 
the modified image of the registered fingerprint has a smaller value than the designated line width value of the narrowing 
process. An outline of the comparison process is described below. 

50 (a) Comparison of the Sub template 

The comparison of the sub-template is the process of calculating the position at which the black pixels of the 
image of the registered fingerprint and. the black pixels of the image of the test fingerprint have the greatest degree 
of concordance. In other words, first, a sub-template RT(0,H,V), in which the approximate center point of the 
registered fingerprint has been aligned with the approximate center point of the test fingerprint, is calculated for 

55 sub-template RT(0) of modified image of a registered fingerprint by means of parallel displacement of the coordinate 

axis of this registered fingerprint. Subsequently, following the rotational and up/down, left/right parallel displace- 
ments of the coordinate axis of sub-template RT(0,H,V) in the neighboring area about the center, the transformation 
angle S and the parallel displacement quantity (horizontal displacement quantity H, vertical displacement quantity 
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V) of sub-template RT(S t H,V) of the modified Image of the registered fingerprint, at the point where the degree of 
concordance between the black pixels of the registered fingerprint and the black pixels of the image of the test 
fingerprint is greatest, are calculated (S,H,V are integers). 

(b) Comparison of the non-sub-template, and comparison of the template 

5 The comparison of the non-sub-template is the process of outputting information relating to the concordance 

of the registered fingerprint and the test fingerprint by means of performing coordinate conversion of the black 
pixel address of RB(0) of the modified image of the registered fingerprint according to S, H, V of RX(S,H,V) of the 
registered fingerprint obtained in the comparison of the sub-templates to calculate the black pixel address, and 
then checking the concordance of this black pixel address with the black pixel address of the modified Image of 

10 the test fingerprint. In other words, initially, coordinate transformation of the black pixels of non -sub-template RB 

(0) of the registered fingerprint is performed using the angular rotational quantity S, horizontal displacement quan- 
tity H, and vertical displacement quantity V, of the coordinate axes of the sub-template of the modified image of 
the registered fingerprint obtained above to obtain RB(S,H,V). Next, the concordance of the black pixels of RB(S, 
H, V) of the modified image of the registered fingerprint to the black pixels of the modified image of the test fingerprint 

w is checked. 

(c) A check is conducted to determine the number of black pixels of a discordant section. 

(d) This check is conducted when optionally selecting to check the sweat glands. 

(e) In accordance with the above results, a final judgment is made with regard to the concordance of the registered 
fingerprint and the test fingerprint. Based on the outline of the above process, an example of a comparison pro- 

20 cedure is shown by procedure C. The sub-template and the non -sub-template of the registered fingerprint, the 

modified image of the test fingerprint and the approximate center point of the test fingerprint serve as the input 
information of procedure C. The output information of procedure C is the comparison result. 



25 



35 



45 



(Procedure C) 
Step CO: 



[0159] The maximum total range of displacement of the registered image information at the time of comparison is 
expressed as follows: interval [S mlfV S max ] represents the rotational angular direction; interval [H mln , H max ) represents 
30 the horizontal direction; and interval [V m}n , V max ] represents the vertical direction. At least one of the intervals indicating 
the displacement direction is divided into one or more partial intervals as follows: 



S fn ,n = {S mln (ls);ls=1,2,... l Js} 

S m ax = {S max (ls); Is =1,2 Js} 

40 H min = {H mln (lh);lh = 1,2 > ...,Jh} 

H ma x = {H niax (lh); In = 1.2, .... Jh} 

V m in = {V mln (lv); lv =1,2 Jv} 

V m axMV max (lv); lv = 1,2, ...,Jv} 

50 

[0160] Interval [S mfrlf S max ] is the aggregate sum of interval [S mln (1), S max (1)], interval [S roln (2), S max (2)],..., and 
interval [S m(n (Js), S max (Js)]. 

[0161] Interval [H mln , H max ] Is the aggregate sum of interval [H mln (1), H max (1)], interval [H mln (2), H max (2)] and 

Interval [H mJn (Jh), H^Jh)]. 

55 [0162] Interval [V mln , V max ] is the aggregate sum of interval [V mln (1), V max (1)J, interval [V mln (2), V raax (2)] and 

Interval [V mln (Jv),V max (Jv)]. 

[0163] Hereafter, from step C1 , the selected partial alignment intervals are sequentially executed with regard to all 
{Interval [S min (1), S max (1)], interval [S min (2), S max (2)] and interval [S mln (Js) t S max (Js)]}, 
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{interval [H^l), rUDL interval [H mln (2) ( H max (2)] and Interval [H mln (Jh), H max (Jh)]}, and 

{Interval [V mln (1 ), V max (1 )J ( interval [V mln (2), V max (2)] and Interval [V m}n (Jv), V max (Jv)]}. 

[0164] In a random alignment Interval, the entire comparison procedure ends when a judgment of concordance Is 
rendered, or when a judgment of discordance is rendered after abandoning the following comparison. 

Step C1 (Comparison of the sub-template): 

[0165] Steps C1a - C1d are executed. 

Step C1a : 

[0166] Sub template RT(0) is stored in memory 6 from the file. Subsequently, the following image concordance aux- 
iliary procedure (procedure W) is executed using: sub-template RT(0), S = S mln (ls)~S max (ls) (incremental value Ks of 
S), H = H^flh^H^lh) (incremental value Kh of H) and V= V mln (lv)~V max (lv) (incremental value Kv of V) wherein 
the registered information black pixel search incremental value Kr = Kra, (Kra>1). 

[0167] From this result, with regard to S mln (ls)~-S max (ls), H mln (lh)-~H max (lh), and V mtn (lv)~V max (lv), the values of S, 
H and V are modified by incremental values Ks, Kh and Kv, respectively, and Sa, Ha, and Va (i.e. the quasi-optimal 
values of S, H, and V) are then calculated. 

Step C1b : 

[0168] With regard to the respective displacement ranges of S, H and V, 

S: (Sa - Dsb) - (Sa + Dsb), incremental value Ksb 



H: (Ha - Dhb) ~ (Ha + Dhb), incremental value Khb 



V: (Va - Dvb) - (Va + Dvb), incremental value Kvb, 

procedure W is executed wherein the registered information black pixel search incremental value Kr = Krb (Krb>1), 
and {Sb, Hb, Vb} (i.e., the quasi-optimal values of {S, H, V}) are calculated. Dsb, Dhb, and Dvb are constants for 
defining the displacement range (See C(1)). 

Step C1 c : 

[0169] With regard to the respective displacement ranges of S, H and V, 

S: (Sb - Dsc) - (Sb + Dsc), incremental vaJue Ksb 



H: (Hb - Dhc) ~ (Hb + Dhc), incremental value Khb 



V: (Vb - Dvc) - (Vb + Dvc), incremental value Kvb, 

procedure W is executed wherein the registered information black pixel search incremental value Kr = Krc (Krc>1), 
and {Sc, He, Vc) (i.e., the quasi-optimal values of {S, H, V}) are calculated. Dsc, Dhc, and Dvc are constants for defining 
the displacement range. 

Step C1d : 

[0170] Procedure W is executed according to S, H, V, 
S=Sc, Dsd=0, incremental value Ksd=0 
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H=Hc f Dhd=0 ( incremental value Khd=0 
V=Vc, Dvd=0, Incremental value Kvd=0, 

wherein the registered information black pixel search incremental value Kr = Krd (Krd=1), and the optimal values {S, 
s H, V} are calculated. Dsd, Dhd, and Dvd are constants for defining the displacement range. From this result, each 
optimal value {S, H, VJ wherein the degree of concordance T1 of the sutHernplate is maximized and the sub-template 
degree of concordance = N 1m /N 1c 
are obtained. Next, for a predetermined number T k1 , if 

10 

the registered fingerprint and test fingerprint are judged to be concordant by means of the comparison of the sub- 
templates, and the procedure moves to step C2. On the other hand, if 

15 

T1 <T kl 

the registered fingerprint and test fingerprint are judged to be discordant in the partial alignment interval undergoing 
20 processing, and the procedure moves to the processing of the subsequent partial alignment interval beginning with 
step C1 . When a partial alignment interval for processing no longer exists, the registered fingerprint and test fingerprint 
are judged to be discordant, and procedure C terminates. 

(0171] In addition, setting T m1 equal to the maximum value of T1 in the partial alignment intervals from 1 to m, when 

25 

T m1 < T mk1(J)' 

due to the low probability of concordance, subsequent processing of the present partial alignment interval, as well as 
comparison processing of the remaining partial alignment intervals are not executed, the registered fingerprint and test 
30 fingerprint are judged to be discordant, and procedure C terminates. In order to execute the aforementioned judgment, 
T mki(j) (i =1 ,2,...,m) represents a previously determined constant. 

Step C2 (Comparison of the non -sub-template and comparison of the template): 

35 [0172] Using the optimal value {S, H, V) obtained from non-sub-template RB(0) and step C1 as input information, 
an auxiliary image concordance check procedure (procedure W) is carried out As a result, N 2m and N 2c are calculated, 
and the following is then obtained using the result of step C1 : 

[0173] Template degree of concordance T2 = (N 1fn + N 2m ) / (N 1c + N 2c ) Next, for a predetermined constant T^, if 

40 

the registered fingerprint and the test fingerprint are judged to be concordant, and the procedure moves to step C3. 
On the other hand, if 

45 

T2<T k2 

the registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment interval undergoing 
so processing, and the procedure moves to the processing of the subsequent partial alignment interval beginning with 
step C1 . When a partial alignment interval for processing no longer exists, the registered fingerprint and test fingerprint 
are judged to be discordant thereby resulting in the termination of procedure C. 

Step C3 (Comparison of discordant sections): 

55 

[0174] In this step, the discordance of the black pixels of the registered fingerprint and the black pixels of the test 
fingerprint is checked. It is necessary to remove cases in which the number of black pixels in the discordant section 
of the Image of the test fingerprint are too large. For this purpose, the following steps C3a ~ C3b are carried out to 
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approximately obtain and judge the ratio of the black pixels of the discordant section at the point where the line width 
of the binary image of the test fingerprint has been aligned with the modified Image of the registered fingerprint. 

Step C3a : 

[0175] The approximate range of the area of comparison of the modified image of the registered fingerprint of {S,H, 
V) is calculated from the ranges of RT(0) and RB(0). The coordinates (X'.Y 1 ) in the region following modification of 
coordinates (X,Y) are calculated in the same manner as in procedure W, found by the following formulae: 

X'= (X - X RC ) • cos(S) + (Y - Y RC ) • sin(S) + X TC - H 



V- -(X - X RC ) • sin(S) + (Y - Y RC ) • cos(S) + Y TC - V 

15 

Note: cos(») and sin(») represent trigonometric functions. 
Step C3b : 

20 [0176] The number of black pixels T^ of the region of comparison following coordinate conversion of the modified 
image of the test fingerprint (i.e., sum aggregation of Fn"(S,H,V) and RBfS.H.V,)) is counted. In other words, 
= Total number of black pixels in the region of comparison 
following coordinate conversion of the test fingerprint image 
At this time, when the line width of the modified image of the test fingerprint is represented by w, the total number of 
25 black pixels T^ when this line width is set to the line width of the modified image of the registered fingerprint (line width 
X) is given approximately by: 

T nc =T nw /(w/X) 

30 

[0177] When the line width of the modified image of the registered fingerprint reaches one pixel by means of thinning, 
it is possible to calculate the number of black pixels T^ of the region of comparison of the modified image of the test 
fingerprint by thinning this modified image of the test fingerprint. In this case, w = X = 1 . In addition, the following has 
already been calculated: 

35 

N im +N 2m= Number of concordant black pixels within the region of comparison following coordinate conversion 

of the modified image of the test fingerprint and the modified image of the registered fingerprint 

N 1c + N 2c = Total number of black pixels within the region of comparison following coordinate conversion of 

the modified image of the registered fingerprint 

40 

[0178] The degree of discordance Tz of the black pixels may, for example, be expressed as follows: 

T2 = n^-N lm -N^)/(N 1c + N & fc 

45 

In the above case, when 

ITzl<;T te> 

50 

with regard to the degree of discordance, the registered fingerprint and the test fingerprint are judged to be concordant; 
In the case where these conditions are not met, the registered fingerprint and the test fingerprint are judged to be 
discordant. 

[0179] Tkc (0 £ T te £ 1 ) is a constant indicating the allowable rate of discordant black pixels of the binary image of 
55 the test fingerprint; as this number decreases, the conditions become stricter (note: normally, Tz £ 0, thus It Is also 
possible to make the conditions stricter when Tz < 0, then when Tz £ 0, by using different values for T^j). When the 
registered fingerprint and the test fingerprint are Judged to be discordant in the partial alignment interval undergoing 
processing, the procedure moves to the processing of the subsequent partial alignment interval beginning with step 
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C 1 . When a partial alignment interval for processing no longer exists, the registered fingerprint and test fingerprint are 
judged to be discordant thereby resulting In the termination of procedure C. 

Step C4 (Comparison of the sweat gland portions): 

[0180] In the present step, in order to increase the accuracy of the comparison, It Is possible to selectively add at 
least one of the following steps C4a and C4b. 

Step C4a (Checking of holes from sweat glands): 

[0181] The hole address modified using optimum value {S, H, V) is checked to determine the existence of a sweat 
gland in the addresses of the modified image of the test fingerprint (note: holes are formed by one or more white pixels 
in an image in which the ridge portions of a fingerprint are represented by black pixels following binary conversion). 
The size of the white pixel aggregation to be checked is represented by parameter constants. Subsequently, when, as 
a result of performing the following calculation, T^ £ T k4a , the checking of the hole of a sweat gland Is judged to be 
successful. 

T^ = (Number of concordant hole addresses) / (Total number of registered hole addresses) 
Step C4b (Checking of non-holes): 

[0182] The non-hole address modified using optimum value {S, H, V} is checked to determine the non-existence of 
a sweat gland in the addresses of the modified image of the test fingerprint. The size of the white pixel aggregation to 
be checked is represented by parameter constants. Subsequently, when, as a result of performing the following cal- 
culation, T^ £ T k4b , the checking of a non-hole is judged to be successful. 

T 4b - (Number of concordant non-hole addresses) / (Total number of registered non-hole addresses) 

Note: T^ is a threshold value constant. 
Step C5 (Final judgment): 

[0183] With regard to the processed partial alignment interval, when the sub-template concordance rate, template 
concordance rate, discordant section rate, and sweat gland check have been successfully completed, the registered 
fingerprint and the test fingerprint are judged to be concordant, thereby resulting in the termination of procedure C. 
However, when the registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment 
interval undergoing processing, the procedure moves to the processing of the subsequent partial alignment interval 
beginning with step C1. When a partial alignment interval for processing no longer exists, the registered fingerprint 
and test fingerprint are judged to be discordant thereby resulting in the termination of procedure C. 
(End of Procedure C) 

[0184] FIGS 1 3A and 1 3B depict a flow diagram showing an outline example of the above comparison process based 
on procedure C. Furthermore, FIGS 1 3A and 13B illustrate an example in which only an interval of an angular rotational 
direction S is divided to form partial alignment intervals. 

[0185] FIG. 14 is a diagram for explaining the checking of discordant sections in the aforementioned comparison 
process. Tnis figure shows the relationship between concordant and discordant sections when the line width of the 
modified image of a test fingerprint is aligned with the line width of the modified image of a registered fingerprint. 
Remarks C(1 ): Each value of the incremental values (Ks, Kh, Kv), which represent the Incremental widths of the primary 
displacement in step C1 a, is checked as a rough value over a comparatively wide range. Each value of the incremental 
values (Ksb, Khb, Kvb), incorporating the quasi-optimal values of the {S,H,V} obtained in step C1a, which represent 
the incremental widths of the second displacement in step C1b, is checked as a precise value over a comparatively 
narrow range. In this manner, when the range of displacement during alignment is large, a greater reduction in the 
processing quantity can be achieved when compared to the case in which fine incremental values are used. 
[0186] In step C1 (a multi-stage process comprising 3 steps) of procedure C, the Incremental value of each value of 
displacement can be increased to greater than 1 in the first and second steps; in the second and third steps, these 
values can be compared over the range defined by means of the line width in the prior step as the cardinal point of the 
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quasi-optimal values of S, H, and V which were determined in the prior step; and it is possible to reduce the processing 
quantity of the comparison (approximately proportionate to the position matching search repetition) due to the fact that 
the number of black pixels of the registered Image can be limited through a skipping procedure which skips a fixed 
number of the black pixels of the registered information in accordance with setting the registered information black 
* pixel search width increment Kr to a value of 2 or greater. The maximum and minimum values of each displacement 
range (S mln , S^, H m , n , H max , V ro)n , V max ) are defined according to the maximum permissible displacement ranges at 
the time of fingerprint input. Step C1d is for the purpose of determining T1 in step C1 . 

[0187] The following characteristics are present. (1) The number of search repetitions increases with increasing 
displacement range; (2) The number of search repetitions increases with decreasing incremental value; (3) The incre- 
10 mental value at a midway step is defined by taking into consideration the incremental width of the immediately preceding 
or immediately succeeding step; (4) For steps other than the final step, a skip search is possible; (5) When the desig- 
nation of the translation limits, the incremental value and the jump search is not appropriate, errors in recognition occurs 
easily. 

[0188] In step C3b, the degree of discordance sections is calculated by approximately setting the line width of the 
is modified image of the test fingerprint to the line width of the modified image of the registered fingerprint. However, it 
is also possible to calculate the rate of discordant sections by approximately setting the line width of the modified image 
of the registered fingerprint to the line width of the modified image of the test fingerprint. 

(13) Auxiliary Procedure for Checking Image Concordance 

20 

[01 89] A summary of an auxiliary procedure (Procedure W) for conducting a check on the concordance of two images 
is explained in the following. The approximate center point (X RC ,Y RC ) for each pixel address (X R ,Y R ) of the sub-template 
RT(0) or non-sub-template RB(0) of the registered fingerprint undergoes parallel displacement so as to become con- 
cordant to the approximate center point (X TC ,Y TC ) of the test fingerprint. Next, the coordinate axis of the registered 
25 fingerprint is rotated, the black pixel (X RO ,Y RO ) address following conversion is checked as to whether or not any 
black pixels exist withjn the fingerprint area of the modified image of the test fingerprint, and parallel displacement is 
again carried out. 

[0190] In the case of RT(S,H,V), S, H and V, and T1 , N 1m and N 1c are calculated for the time when the degree of 
concordance T1 reaches a maximum for each value of S, H and V. With regard to RB(S,H,V) t S, H, and V each re- 
30 spectively represent only one case. Additionally, in procedure W, T1 and T2, N 1m and N 2m , and N 1c and N 2c are referred 
to as T", "N m ", and "N c w , respectively. 

[0191] The aggregation of black pixel addresses of a specified portion of the modified image of the registered fin- 
gerprint (either RT(0) or RB(0)), angular conversion quantity S of the coordinate axis (minimum value, maximum value, 
incremental value), horizontal displacement H of the coordinate axis of the registered fingerprint (minimum value, 
35 maximum value, incremental value), vertical displacement V of the coordinate axis of the registered fingerprint (mini- 
mum value, maximum value, incremental value), the modified image of the test fingerprint and the skip count J based 
on the skip search of the black pixels of the registered fingerprint serve as the input information of procedure W. The 
displacement range Is the entire interval or partial interval. 

[0192] When comparing the black pixels of the registered fingerprint with those of the test fingerprint, the registered 
40 information black pixel search incremental value Kr designates the increment by which the black pixels of the modified 
Image of the registered fingerprint are searched. For example, when Kr=1 all of the black pixels of the modified image 
of the registered fingerprint are searched, and when Kr=2, every other black pixel of the registered fingerprint is 
searched. 

[0193] The optimal angular degree of rotation S about the coordinate axis for the registered fingerprint, the optimal 
45 coordinate axial horizontal displacement quantity H, the optimal coordinate axial vertical displacement quantity V, the 
number of concordant black pixels N m of the modified image of the test fingerprint and the modified image of the 
registered fingerprint In the specified region (either RT(0) or RB(0)), the total number of black pixels N c of the modified 
Image of the registered fingerprint of the specified region and the degree of concordance T. 

[0194] FIG. 15 is a flow diagram showing an outline of the auxiliary procedure for checking image concordance 
so (Procedure W) in the comparison process. An example of the processing of procedure W is explained in the following. 

(Procedure W) 

Step W1 (Selection of angle S): 

55 

[0195] Depending on the input information of angle S, with regard to the designated interval, S is sequentially selected 
by means of the Incremental value of S from the minimum value of S to the maximum value of S (i.e., the minimum 
value of S Is S mbv the maximum value of S Is S^, and when the Incremental value Is Ks f S varies from S m!n to S max 
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according to S = S mln (ls), S mfrl (ls)+Ks,..., S^), following which the procedure moves to step W2. 

Step W2 (Coordinate conversion according to angle S): 

s [01 96] With regard to the black pixels of the modified image of the inputted registered fingerprint (either RT(0) or RB 
(0)), and with respect to the black pixel address (X^Yr) which is to be searched using the registered Information black 
pixel search incremental value Kr, 

(a) when S = 0, 

10 

X R© = X R ' X RC + X TC 



15 Y RO - Y R " Y RC + Y TC 

are set. 

(b) whenS*0, 

20 [0197] Following parallel displacement to align the approximate center point (X RC ,Y RC ) of the registered fingerprint 
to the approximate center point of the test fingerprint (X TC ,Y TC ), coordinate axis rotation over an angle S° is performed 
with respect to all of the black pixel addresses (X R , Y R ) of a black pixel aggregation of the modified image of an inputted 
registered fingerprint (either RT(0) or RB(0)). This is carried out according to, 

X RO = (X R -X RC ) • cos(S) + (Y R -Y RC ) • sin(S) + X TC 



Y RG = -( x r- x rc) * sin(S) + (Y R -Y RC ) • cos(S) + Y TC 

Accordingly, an aggregation of all black pixel addresses (X R0 ,Y R0 ) of the new registered fingerprint at the time when 
H=V=0 is calculated. 

[0198] According to the above, the approximate center (X RC ,Y RC ) of the registered fingerprint is rotated S degrees 
about the coordinate axis of the registered fingerprint and an aggregation of all black pixel addresses (X RO , Y RO ) of 
the new registered fingerprint is obtained when: 
[01 99] Horizontal displacement H = Vertical displacement V = 0 

Step W3 (Calculation of the degree of concordance T): 

40 Step W3a : 

[0200] Initially, the counter for the number of concordant black pixels Nm and the counter for the total number of 
black pixels N c of the modified image of the registered fingerprint are respectively reset to "0 M . 

45 Step W3b : 

[0201 ] For each address of the aggregation of (X RO , Y RO ), the modified image of the test fingerprint is checked while 
applying the following: 

so (a) If the aggregation consists of black pixels within the fingerprint area, "1 n is added to the counter for the number 

of concordant black pixels N m , and "1" is also added to the counter for the total number of black pixels N c of the 
registered fingerprint. 

(b) If the aggregation consists of white pixels within the fingerprint area, or if the aggregation lies outside the 
fingerprint area (treated as neither white nor black), "1 " is added to the counter for the total number of black pixels 
55 N c of the registered fingerprint. 

At this point, a check is performed to determine whether or not the abandonment of the comparison is possible for {S, 
H.VJ in the comparison processing of the sub-template. 
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[0202] in other words, since the registered fingerprint information to be checked is an aggregation of black addresses, 
this Information is classified Into k continuous intervals according to the search sequence; at the end of each interval 
l(i= 1,2 k), when 

5 

counter N c = N d , 

the Nm at this time is set to N ml (i=1,2 f ...k), and the degree of concordance up to that point of the pattern defined 
according to the values of S, H and V, is represented by N m , / N d and thus, with regard to a constant Tel (i=1 ,2,...,k), 
10 jn the case when 

N ro ,/N d <T cI , (MA...K). 

15 (T C | and k are constants. See Remarks W(1 ).) even if a subsequent check is conducted, there will not be a significant 
degree of concordance obtained at the current values of S, H, and V, hence the current S, H, and V values at this point 
are discarded, and the procedure moves to step W4 in order to advance to the subsequent S, H, and V values. 
[0203] The following process (neighboring pixel search at the time of comparison) can be selectively performed (This 
neighboring pixel search process can be selectively applied at each processing stage of the sub-template RT, and/or 

20 at the stage of the non-sub-template RB.). 

[0204] The case when the black pixel of the modified image of the registered fingerprint of an optional address (e. 
g. , address A) within the image corresponds to the black pixel of address A of the modified image of the test fingerprint, 
is referred to as "concordance" or "true concordance" with regard to the pixel. 

[0205] When the black pixel of the modified image of the registered fingerprint of an optional address (e.g., address 
25 A) within the image corresponds to a white pixel of the same address A of the modified image of the test fingerprint, 
the neighboring addresses of address A of the modified image of the test fingerprint are checked for the presence of 
black pixel. When at least one black pixel is present, the black pixel of the modified image of the registered fingerprint 
of address A is judged to be concordant with the black pixel of the modified image of the test fingerprint (when it is 
necessary to distinguish such concordance from true concordance, such concordance is referred to as "approximate 
30 concordance"). At this time, during comparison of the black pixel of the modified image of the registered fingerprint, it 
is designed such that the approximately concordant black pixels, as well as the concordant black pixels of the modified 
image of the test fingerprint are not used for comparison more than once. In order to achieve this result, the following 
operations are conducted. 

[0206] The modified image of the test fingerprint is placed into the working area of memory. With regard to the black 
35 pixels of the modified image of the test fingerprint which have been judged to be concordant with the black pixels of 
the modified image of the registered fingerprint by means of either true or approximate concordance, the pixel value 
of image memory is converted into an intermediate value other than the brightness value of a black or white pixel (e. 
g. t when the brightness of a black pixel and white pixel are "0" and "255", respectively, the brightness of true concord- 
ance is Ba (e.g., a value other than that of a black pixel or white pixel, such as "50"), and the brightness of approximate 
40 concordance is Bb (e.g., "100")). In the comparison of the black pixel of the modified image of the test fingerprint and 
the black pixel of the modified image of the registered fingerprint, repeated comparison of concordant and approximately 
concordant black pixels of the test fingerprint of addresses within the same Image is prevented since previously com- 
pared pixel values are converted to intermediate values in image memory (i.e., the intermediate values of previously 
compared image memories are checked). When the comparison of the modified image of the test fingerprint and the 
45 modified image of the registered fingerprint using one set of values {S, H, V} is completed, the modified image of the 
test fingerprint is returned to its original state using the information placed into the working area of memory. 

Step W3c : 

so [0207] When step W3b has been completed for ail of the addresses of the aggregations of (Xr^Yr©), 

T=N m /N c 

55 is calculated, and N m , N c and T for this {S.H.V} are memory stored. 
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Step W4 (Parallel displacement according to H and V) 

[0208] For the black pixel address (X 0 , Y € ) of the new registered fingerprint when H=V=0, H and V, which have been 
set in the H, V storage area are selected in sequence (when H=V=0, calculation has already been completed in step 

5 3). When the values of H from its minimum value to its maximum value and the values of V from its minimum value to 
its maximum value are changed sequentially by each increment (I.e., the minimum value of H is H mln , the maximum 
■ s H max» wnen tne incremental value is Kh, the value of H changes according to H = H min (Ih), H m | n (lh)+Kh,... until the 
maximum is reached; the minimum value of V is V m j n , the maximum is V^, when the incremental value is Kh t 
the value of H changes according to V=V m{n , V mln +Kv,...) t (X 0 -H, Y 0 -V) becomes the black pixel address aggregation 

10 of the new registered fingerprint following parallel displacement, hence processing Identical to step W3 is carried out 
for each set of {S,H t V}. 

Step W5 (Check of unprocessed S): 

is [0209] When a value of an unprocessed S is present, the procedure returns to step W1 ; When a value of an unproc- 
essed S is not present, the procedure moves to step W6. 

Step W6 (Judgment of the maximum degree of concordance): 

20 [0210] For each {S.H.V}, according to each value of S and each {S,H,V} according to the change in H=H m , n -H max , 
v=v min~ v max. tne values of S, H, and V, and the values of T, N ro and N c are calculated as the output information for 
the case when T= N m / N c reaches a maximum. Even when only one value for each of S, H, and V, respectively, is 
inputted, T, N m and N c are designated as the output information. 
(End of procedure W) 

25 [0211] FIG. 16A is a diagram for explaining an example of the neighboring pixel search in the comparison process. 
FIG. 16B, with regard to the black pixel address A of the registered information from a registered fingerprint, shows 
cases: (1) when address A of the modified image of the test fingerprint is a black pixel, address A of the modified image 
of the test fingerprint and address A of the modified image of the registered fingerprint are totally concordant; and (2) 
when address A of the modified image of the test fingerprint is not a black pixel, e.g., when address B of the modified 

30 image of the test fingerprint is a black pixel, address A of the modified image of the test fingerprint and address A of 
the modified image of the registered fingerprint are approximately concordant. In addition, FIG. 1 6B shows the recip- 
rocal relationship of concordance and approximate concordance; an overlap check is performed in order to prevent 
the overlap of black pixel of the modified image of the test fingerprint, which has already been compared once as truly 
or approximately concordant, from the black pixel address of the modified image of another registered fingerprint. 

35 [021 2] In other words, black pixel a of the modified image of the registered fingerprint is totally concordant with black 
pixel d of the modified image of the test fingerprint; black pixel b of the modified image of the registered fingerprint is 
approximately concordant with black pixel e of the modified image of the test fingerprint; and black pixel c of the modified 
image of the registered fingerprint is discordant with the modified image of the test fingerprint. When checks for total 
concordance and approximate concordance are performed, it is designed such that neither black pixel d nor black 

40 pixel e, both of which have already been compared, is overlapped and designated again as concordant. 

[021 3] Furthermore, it is possible to designate the search range forjudging approximate concordance by considering 
four or eight neighboring pixels, taking into consideration the distortion state of the Image at input, etc. 
Remarks W(1): The value of T d (i=1,2,...k) in step W3b is 0 5 T d £ 1 , however it is possible to determine this value, 
for example, as described in the following. When total number of black pixels of a modified image of a registered 

45 fingerprint is set to N c , NJN,, (i=1 ,2,...k) indicates the progression state of the processing wherein the range is repre- 
sented by 0 <, NJHc £ 1. As N d increases and approaches N c , N m /N d approaches N m /N c , which is the degree of 
concordance with respect to the {S,H,V} currently being checked, thus it is possible to set T cj such that N d is as large 
as possible. 

[0214] As T d increases, the range for midway abandonment also increases. There is a considerable effect on the 
so decrease in the processing amount, however, due to the frequency with which errors in recognition are generated, it 
is necessary to set an appropriate value for T d . The maximum frequency of this calculation is determined according 
to the set value of k. If midway abandonment of a comparison is carried out one time, the calculation for the possibility 
of midway abandonment for the values of {S,H f V} after that point is not necessary. In addition, it is necessary to set a 
concrete value of T d according to the characteristics of the desired image. Furthermore, If the condition expression 
55 defining the range of the midway abandonment of the comparison also defines the degree of concordance up to that 
point; this condition expression is not limited to the example shown In procedure W. Remarks W(2): The method of 
step W2 signifies the following. For ail the addresses (Xr.Yr) in step W2, the new address following parallel displace- 
ment to align the approximate center point (Xrq, Y rc ) of the registered fingerprint concordant to the approximate center 
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point (X TC ,Y TC ) of the test fingerprint is as follows: 



x r#- x r " ( x rc ' x tc) 



Y R#- Y R ' ( Y RC * Y TC) 

(X R#I Y R# ) then forms the new address. Subsequently, coordinate axis rotation of S degrees is carried out about (X TC , 
Y TC ). This may be obtained according to the following: 

x ro - ( X R# ' x rc) • <"s(S) + ( y r# - y tc) • sin(S) + X TC 
= (X R - X RC ) • cos(S) + (Y R - Y RC ) • sin(S) + X TC 

y ro - -(X R# - X TC ) • sin(S) + (Y R# - Y TC ) • cos(S) + Y TC 
= -< X R " x rc) • sin(S) + (Y R - Y RC ) • cos(S) + Y TC 

(It Is possible to maintain the values of the variable range of the predetermined angle S by means of the values of the 
sin(») and cos(«) trigonometric functions.) 

(14) Flow of Registration Processing and Comparison Processing 

[0215] FIG. 17 is a flow diagram showing an outline of the registration processing and the comparison processing 
of a fingerprint. The registration process is the process of registering the registration information of a fingerprint in 
memory 6 of image processing unit 1 . The comparison process is the process of judging the concordance of a test 
fingerprint and a registered fingerprint. A flow chart outline from input of the fingerprint up until the registration or 
comparison process is shown in the following procedure Z. 

(Procedure 2) 

[0216] Steps ZA1 ~ ZA5 represent the processes common to both the registration processing and comparison 
processing. 

Step ZA1 : 

[0217] Input of a fingerprint from image input device 2 into image memory 4. 
Step ZA2 : 

[0218] Smoothing of the gray-scale image of the fingerprint in image 1 0 of image memory 4. 
Step ZA3 : 

[0219] Binary conversion and background segregation of image 1 0 by means of procedure B. 
Step ZA4 : 

[0220] Calculation of the approximate center point of the fingerprint image in image 1 0. 
(End of steps ZA1 - ZA4) 

[0221] The following processes are separated into registration processing and comparison processing. 

[0222] Steps 2R1 ~ ZR2 are applied during the registration process; these steps record the registered information 

of the registered fingerprint Into memory 6. 
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Step ZR1 : 

[0223] Narrow processing within the fingerprint area is carried out on the binary image (primary image) of the reg- 
istered image in image 10, and a modified image of the registered fingerprint (primary modified image) is obtained. 

5 

Step ZR2 : 

[0224] The processing of registered information of the registered fingerprint is carried out (procedure R). 
(End of steps 2R1 - ZR2) 

10 [0225] Steps ZC1 ~ ZC2 are applied during the comparison process; these steps perform the comparison of the 
test fingerprint and the registered fingerprint. 

Step ZC1 : 

15 [0226] Black pixel ratio standardization or narrowing of the fingerprint area of the binary Image of the test fingerprint 
(secondary image) in image 1 0 is performed, and a modified image of the test fingerprint (secondary modified image) 
is obtained. It is not necessary to repeat standardization of the black pixel ratio in the case when this process has been 
performed in step ZA3. 

20 Step ZC2 : 

[0227] Judgment is made on the concordance of the registered fingerprint and the test fingerprint by means of the 
aforementioned comparison processes (procedure C, procedure W). 
(End of steps ZC1 ~ ZC2) 

25 [0228] In the registration processing of the image, a plurality of images can be sequentially inputted and maintained. 
These images are then compared, and the image with the best concordance can be selected as the image for regis- 
tration. FIG. 18 is a flow diagram showing an outline of this registration process by means of which the optimum 
registered fingerprint is selected from among a plurality of input images. An example of this procedure is shown by 
procedure RR. 

30 

(Procedure RR) 
Step RR1 : 

35 [0229] The fingerprint image is inputted into image memory, and. the inputted fingerprint image is stored in a file. 
This operations is repeated a specified number of times (note: In this example, this specified number is 3 times; the 
files containing the fingerprint images are designated, for example, z1, z2 and z3.). 

Step RR2 : 

40 

[0230] With regard to the plurality of inputted images, a comparison process is conducted in accordance with the 
following combinations; when concordance is detected, the degree of concordance T2 of each template is recorded 
into memory. 

[0231] During this comparison process, at the time when a comparison discordance is generated, the registration 
45 process is abandoned, and the procedure is re-executed from step RR1 . 

[0232] When the comparison of registered fingerprint z1 and test fingerprint z2 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q 12 . 

[0233] When the comparison of registered fingerprint z1 and test fingerprint z3 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q 13 . 
so [0234] When the comparison of registered fingerprint z2 and test fingerprint z1 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q 21 . 

[0235] When the comparison of registered fingerprint z2 and test fingerprint z3 results, in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Qgg. 

[0236] When the comparison of registered fingerprint z3 and test fingerprint z1 results in a final judgment of con- 
55 cordance, the degree of concordance T2 of the template is calculated and set as Q 31 . 

[0237] When the comparison of registered fingerprint z3 and test fingerprint z2 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q32. 

[0238] The number of final Judgments of concordance must meet specified conditions (e.g., when the comparison 
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process is conducted six times, as described above, specified conditions requiring, for example, at least four final 
judgments of concordance may be designated.). 

[0239] Subsequently, the average degree of concordance is calculated for each input image. For example, in the 
case when all of the aforementioned comparisons are concordant, 

5 

for z1 , average degree of concordance 

Q1=(Q 12 + Q l3 )/2; 

10 

for z2, average degree of concordance 

Q2 = (Q 21+ Q23)/2; 

15 

and 

for z3, average degree of concordance 
20 Q3 = (Q 3 1+Q32)'2. 

Step RR3 : 

[0240] The maximum Qi is calcuiated from among the average degrees of concordance Qi = {Q1 , Q2, Q3}, and is 
25 registered using the registration information of fingerprint zi corresponding to the i above. 
(End of procedure RR) 

[0241] The number of input images at the time of registering one fingerprint may be an optionally designated value 
of at least one. Increasing the number of input images increases the possibility of selecting a high quality image as the 
registered fingerprint image, however, this also results in an increase in the registration processing amount, thus the 
30 number of input images is determined by considering a balance between these aspects. The selection of combinations 
for the comparison of reciprocal regions of the input images is not limited to the above description, as it is also possible 
to select only a portion of the aforementioned combinations as well. The process for selecting the fingerprint images 
for registration is also not limited to the aforementioned use of the average degrees of concordance, as other methods 
are also possible. 

35 

(15) Comparison of 1 to N 

[0242] The comparison process described in the aforementioned embodiments judges whether or not one test fin- 
gerprint is concordant with the registered information of one registered fingerprint. Using this comparison process, in 
40 order to judge whether or not one test fingerprint is concordant with at least one registered information from among 
an optional number of registered information, it is clear that the comparison process must be sequentially performed 
with regard to each registered information until a judgment of concordance results. However, a drawback exists in this 
process in that increasing the number of registered information results in an increase in the processing amount for 
comparison. 

45 [0243] From among an optional number of registered information, when one registered information which is con- 
cordant with one test fingerprint is discovered, the following procedure N A can be executed. FIG. 1 9A shows the 
relationship between the test fingerprint and registered fingerprint; FIG. 19B is a flow diagram showing an outline of 
this aforementioned 1 to N comparison process. 

so [Procedure NA] 

[0244] The partial interval of {S,H,V} is divided into first, second, .... nth partial segments. The original segment {S, 
H,V) is accordingly the aggregate sum of all partial segments. The partial segments may be provided independently 
from the partial alignment intervals, or optionally may utilize the partial alignment intervals. A simple example of a 
55 partial segment includes selecting a segment in which concordance occurs frequently (e.g., {S=0, H^H^-H^, 
v = v min~ v max} as tne first P artial segment, and then selecting a partial segment other than this first partial segment. 
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(Procedure NA) 
Step NA1 : 
s [0245] Input of test fingerprint. 
Step NA2 : 

[0246] Sequential selection of partial segments. 
10 [0247] In the comparison of the first partial segment, the comparison of a test fingerprint with registered information 
(i = 1 , 2, .... n) is performed with respect to the first segment {S,H,V} until concordant registered information is discov- 
ered. When It is not possible to find concordant registered information among the registered information processed in 
the first comparison, the procedure proceeds to the second comparison. 

[0248] In the comparison of the second partial segment, the comparison of a test fingerprint with registered informa- 

15 tion (i = 1 , 2 n) is performed with respect to the second segment {S.H.V} until concordant registered information is 

discovered. When it is not possible to find concordant registered information among the registered information proc- 
essed in the second comparison, the procedure proceeds to the third comparison. 

[0249] This comparison procedure continues, as described above, until a concordant registered fingerprint image is 
discovered. The procedure ends when a concordant registered fingerprint image is discovered. In the case when a 
20 concordant registered fingerprint image cannot be found, the procedure ends after processing the last partial segment. 
(End of procedure NA) 

[0250] With regard to the test fingerprint and concordant registered information, according to this above-described 
procedure, the processing amount for comparison up until the discovery of concordant registered information can be 
significantly reduced. 

25 

(16) Substitution of the degree of discordance 

[0251] During the comparison process, it is possible to use the following process in place of judging the aforemen- 
tioned degree of discordance. 

30 [0252] When comparing a binary image for registration and a binary image for testing (binary test image), the reg- 
istration information of the aforementioned binary image for the registration , and the image of the registration informa- 
tion in which the black/white pixels of the aforementioned binary image for the registration have been reversed (reverse 
registered image) are separately registered; the concordance of the binary test image and the registered information 
are compared; and the concordance of the reverse image of the binary test image and the reverse registered image 

35 of the registered information are compared. When the final judgments of the aforementioned two comparisons both 
indicate concordance, the binary image for registration and the binary test image are judged to be concordant, and the 
check using the degree of discordance (e.g., degree of discordance) can be omitted. However, when selecting this 
procedure, although calculation of the degree of discordance can be omitted, drawbacks exist in that the registration 
amount and comparison time both increase. An example of the process relating to the registration procedure is shown 

40 by procedure RVR. An example of the processing relating to the comparison procedure is shown by procedure RVM. 

(Procedure RVR) 
Step RVR1 : 

45 * 

[0253] The registration process is performed on a fingerprint for registration, and the registration information therein 
is registered. 

Step RVR2 : 

50 

[0254] At the time of binary conversion of the registered fingerprint, the black and white pixels are reversed, following 
which the registration process is performed on this binary image (referred to as "reverse binary registered image"), 
and the reverse registered information of the above registered fingerprint is then registered. 
(End of procedure RVR) 

55 
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(Procedure RVM) 
Step RVM1 : 

5 [0255] A test fingerprint and registered fingerprint are compared using a comparison process. At this point, the check 
of the degree of discordance is omitted. 

Step RVM2 : 

w [0256] The white and black pixels are reversed when performing binary conversion of a test fingerprint, and this 
binary image (referred to as "reverse binary test image") is then compared with the reverse registered information of 
a registered fingerprint by means of a comparison process. At this point, the check of the degree of discordance is 
omitted. 

(End of procedure RVM) 

*5 [0257] FIG. 20A is a flow diagram showing an example of the process relating to the registration procedure; FIG. 
20B is a flow diagram showing an example of the process relating to the comparison procedure. 

(17) Expansions and Modifications 

20 [0258] The present invention is not limited to the aforementioned embodiments, as it is possible to apply, for example, 
the following expansions and modifications. The methods of calculating the degree of concordance and degree of 
discordance in the image input method, smoothing process, binary conversion process, background segregation proc- 
ess, correction process, process for calculating an approximate center point, thinning or narrowing process, and com- 
parison process are not limited to the descriptions contained in the embodiments and claims of the present invention, 

25 as modifications, expansions and/or partial omissions utilizing other methods (e.g., conventional methods) may also 
be employed. The method of designating the X and Y-coordinates is similarly optional. In alignment, when the drift in 
the rotation is small enough to be ignored, it is possible to check only those potential positional errors in parallel dis- 
placement, and to judge the maximum degree of concordance from this degree of concordance. 
[0259] In step W2 of procedure W, when the conversion which carries out rotational and parallel displacement is 

30 performed, the expression for obtaining X RO and Y RO may be utilized. However, this is not limit to the embodiments 
of the present invention in any manner. For example, it is also possible to utilize the following: 

X R0 - X R • cos(S) + Y R ♦ sin(S) 

35 

Y Re =0( R «sin(S) + Y R *cos(S) 

Furthermore, the utilization of coordinate conversion or geometric transformation is similarly not limited to the afore- 
40 mentioned. The processing quantity necessary for comparison can be reduced due to the addition of a value for carrying 
out rotational and parallel displacement of the sub-template as registered information (in this case, the memory quantity 
increases). 

[0260] In the embodiments of the invention of the present invention, the case in which the image is a fingerprint is 
disclosed, however, the present invention can be appropriately applied to any image which is constructed from lines. 
45 The classification of the sub-template and non-sub-template is not limited, and. expansions such as classifying neither 
or setting many classifications are also possible. In addition, it is also possible to individually select one or more of the 
aforementioned processes and respectively apply them to an optional image processing apparatus. 

Results of the Invention 

50 

[0261] In the present invention, the capabilities of an image processing apparatus In the recognition of a fingerprint 
or image similar to a fingerprint can be improved by means of selecting and applying at least one of the means and/ 
or processes described in the aforementioned embodiments. The main results of the present invention are summarized 
below. 

55 

(1) In the comparison of registered information and a test image, during the binary conversion process, the fluc- 
tuation of the inputted gray-scale image Is offset by means of standardizing the ratio of black pixels of the test 
image to a specified range, and hence the precision of the comparison Judgment can be increased. In addition, by 
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means of appropriately setting the specified range of the black pixel ratio, degree of concordance and degree of 
discordance, the recognition error rate (I.e., the probability of mistaking another Individual's fingerprint as the fin- 
gerprint of the person in question, or vice versa) can also be reduced. 

(2) At the time of binary conversion following division of the image into a plurality of partial regions, the discontinuity 
of the binary image generated at the boundaries of the partial regions can be reduced by means of modifying the 
average brightness value of the partial regions using the reciprocal relationship of the partial regions, and by 
performing binary conversion using this modified average brightness value. 

At the time of binary conversion following division of the image into a plurality of partial regions, within a partial 
region, by means of binary converting a partial region possessing an average brightness value within a first spec- 
ified range and a brightness modification amount within a second specified range using a threshold value deter- 
mined with regard to all regions of the image, the noise effects of an image, generated upon using the image input 
unit, to the binary image following binary conversion can be reduced during binary conversion of a minute variable 
portion of the brightness. 

In the binary conversion in which the binary conversion process is repeated to standardize the ratio of black 
pixels following modification of the brightness threshold value for binary conversion, with regard to nonuniformity 
and fluctuation of the brightness of the input image, it is possible for the ratio of black pixels to approach the 
threshold value which results in the ability to clearly define fingerprint lines, as well as reduce the fluctuation of the 
line widths. 

(3) By dividing a displacement interval of at least one direction into a plurality of partial intervals to form partial 
alignment intervals over a displacement range in which alignment comparison occurs, the processing amount for 
comparison can be significantly reduced when a final judgment of concordance results during sequential compar- 
ison of the partial alignment intervals, since the comparison process need is not conducted on the remaining partial 
alignment intervals following the interval in which a judgment of concordance of both images was rendered. 

In addition, the processing amount for comparison can be further reduced since in the aforementioned partial 
alignment intervals (1,2, n), when a maximum value of the degree of concordance falls outside of a specified 
range, a judgment of discordance is rendered without processing the remaining partial alignment intervals. 

(4) In the case where a random address A in the memory of the registered image is a black pixel, and the address 
A in the memory of a test image is a white pixel, when a predetermined number of neighboring addresses of 
address A of the test image are searched and a black pixel exists, the black pixel of address A of the test image 
is judged to be concordant with the black pixel of address A of the registered image; and in subsequent comparison 
of the above registered image and test Image judgments regarding the concordance of black pixels from other 
addresses of the registered image which overlap black pixel of address A of the test image. Therefore the fluctuation 
in the distortion of the lines of an image can be effectively countered by checking the neighboring information of 
a black pixel of a registered Image in the above-described manner. 

(5) In the case where an optional check of the portions corresponding to sweat glands of a finger is selected, during 
comparison processing of the registered image and test image, when a hole is detected in the test image, all 
registered holes are examined for concordance with this hole, and when the number of concordant registered 
holes exceeds a predetermined ratio, a judgment of concordance is rendered with regard to the registered image 
and test image. As a result, an extremely strict comparison can be performed. 

(6) In the case when, upon comparing a test image and registered information, as well as a reverse test image (in 
which the brightness of the original test image is reversed) and reverse registered information, both of these com- 
parisons produce successful results, a judgment of concordance Is rendered with regard to the registered image 
and test image. As a result, calculation of the degree of discordance can be omitted. 



Claims 

1 . A method for processing images for comparing a test Image with one or more registered images and for Judging 
whether said test image is originated from the same object as one of the registered images, and comprising 
processing steps of : 

a) storing a registered image in an image memory ; 

b) binary converting (B1) said registered image into a binary registered image by using each brightness value 
of each pixel of said registered image, and said binary converting includes: 

c) determining (B1c) whether a ratio of a total number of black pixels to a total number of black pixels and 
white pixels in said binary registered image is within a first predetermined range ; and if said ratio is not within 
the first predetermined range, starting again step b) and step c) by changing one or more threshold values 
until a binary registered image has said ratio within the first predetermined range ; 
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and further comprising : 

d) thinning said binary registered image to obtain a thinned binary registered image, 

e) storing and binary converting a test image in the same manner as said registered image and obtaining a 
binary test image ; 

f) comparing (CO, C 1 , C2) said thinned binary registered image and said binary test Image to determine whether 
said binary test image is originated from the same object as said registered image, 

and said comparing includes: 

g) determining (W3b) that a black pixel of said thinned binary registered image is concordant with a pixel of said 
binary test image, either when a brightness value of said black pixel of said thinned binary registered image having 
an address is concordant with a brightness value of said pixel of said binary test image having a corresponding 
address, or is concordant with a brightness value of a neighboring pixel of said pixel of said binary test image ; 
and further comprises, 

h) Judging (C5) whether a degree of concordance between said binary test image and said thinned binary registered 
Image satisfies a predetermined condition of concordance, and determining whether said binary test image is 
originated from the same object as said registered image according to said degree of concordance. 

An image processing apparatus storing one or more registered images, and comprising : 

means for binary converting (B1) a registered image into a binary registered image, wherein said means for 
binary converting determines (B1c) whether a ratio of a total number of black pixels to a total number of black 
pixels and white pixels in said registered image is within a first predetermined range, and if said ratio is not within 
the first predetermined range, said binary converting means reconverts said registered image by changing one or 
more threshold values until a binary registered image has said ratio within the first predetermined range ; 
and further comprising : 

means for thinning said binary registered image ; 

means for binary converting a test image in the same manner as said registered image ; 
means for comparing (CO, C1 , C2) said thinned binary registered image and said binary test image to determine 
whether said binary test image is originated from the same object as said registered image, wherein said 
means for comparing is characterized by, 

means for determining (W3b) that a black pixel of said thinned binary registered image is concordant with a 
pixel of said binary test image, either when a brightness value of a black pixel of said thinned binary registered 
image having an address is concordant with a brightness value of said pixel of said binary test image having 
a corresponding address, or is correspondent with a brightness value of a neighboring pixel of said binary test 
image ; » 

and further comprising, 

means forjudging (C5) whether a degree of concordance between said binary test image and said binary 
registered image satisfies a predetermined condition of concordance ; and determining whether said binary test 
image is originated from the same object as said registered image according to said degree of concordance. 

An image processing apparatus as claimed in claim 2, further comprising, 

means (IN) for fixing a test image during inputting from an image input to an image memory, 

including means (IN) forjudging inputted images to be valid when the average brightness value for each of a 

predetermined number of one or more image regions is within a predetermined range, and 

means (ET) for modifying 

the inputted image into a modified image having a required number of pixels for comparing processing. 

An image processing apparatus according to claim 2, in which said means (B1) for binary converting comprises 

means for dividing (B1a) said test image into a plurality of partial regions, 

means (B1b) for obtaining an average brightness for each of the plurality of partial regions, 

means (B1c) for determining a threshold brightness value for each of the plurality of partial regions and for 

converting said test image into a binary test image with reference to the threshold brightness value of each 

said partial region and of regions neighboring each said partial region, and means for obtaining the ratio of 

the total number of black pixels to the total number of black pixels and white pixels, 



39 



EP0 623 890 B1 



and means (B1c) for repeating said binary conversion of said test image to change said threshold brightness 
value until said ratio of black pixel to the total number of black pixels and white pixels is within the first prede- 
termined range, and the binary test image obtained after repeated conversion is used for comparison with 
said binary registered image. 

5 

5. An image processing apparatus according to daim 4, further comprising : 

means (B1 b) for determining said threshold brightness value of a partial region with reference to said average 
brightness value (6av(x,y))) of said partial region and at least one average brightness of at (east one neighboring 
partial region. 

w 

6. An image processing apparatus according to claim 4, in which said threshold brightness value of a partial region 
is determined to be equal to a predetermined value if said average brightness value (Bav(x.y)) of said partial region 
lies within a predetermined range and each absolute difference value between said average brightness value and 
each brightness value (f(x ( y)) of each pixel of said partial region lies within a predetermined range. 

15 

7. An image processing apparatus according to claim 2, wherein said means (C 2 C 3 ) for comparing further determines 
a degree of discordance between said binary test image and said binary registered image by detecting discordance 
of black pixels of said binary test image after thinning and black pixels of said registered image, and compares 
said degree of discordance with a predetermined value. 

20 

8. An image processing apparatus according to claim 2, further comprising means for storing (R) image data including 
means for compressing and recording (G) image data as a compressed address Information of black pixels in a 
plurality of pixel aggregations of a valid image, 

wherein said compressed address information comprises a position on the X-axis of black pixels in a pixel 
25 aggregation, a code and a format identification data of respective pixel aggregation. 

9. An image processing apparatus according to claim 2, in which said means (CO, C1 ) for comparing said thinned 
binary registered image and said binary test image includes a means (CO) for moving at least one of the two binary 
images in one or more intervals in order to compare said two binary images, wherein each said one or more 

30 intervals is divided into a plurality of partial intervals, 

means (C) for judging whether said binary test image satisfies a predetermined condition of concordance and 
discordance with said binary registered image in one of said partial intervals, 

means (C) for successively displacing said one partial interval until said predetermined condition of concord- 
35 ance and discordance is satisfied, 

means (C3) for checking discordant sections and 

means (C5) for judging said binary test image as originating from a same object based on predetermined 
condition of concordance and discordance and on the results from the checking means. 

40 10. An image processing apparatus according to claim 2, further comprising means for aligning said binary test image 
and said thinned binary registered image, 

and wherein said means (C) forjudging further judges whether said binary test image originates from a same 
object as said thinned registered image according to said degree of concordance and a degree of discordance. 

45 11 . An image processing apparatus according to claim 2, further comprising means for aligning (CO, C1 ) said binary 
test image with said thinned binary registered image comprising : 

means (C1 , W) for moving at least one of the two binary images in one or more intervals in order to compare 
said two binary images, wherein each said one or more, intervals is divided into a plurality of N partial intervals, 
so and 

means for judging whether said binary test image satisfies a predetermined condition of concordance with 
said binary registered image in one of said N partial intervals ; 

means for successively displacing said N partial intervals of an m-th (m is a positive number) order of said 
partial intervals ; 

55 means (C, W) for judging that said binary test image originates from a same object as said binary registered 

image when said predetermined condition of concordance is satisfies prior to the m-th order of successive 
displacement ; and 

means (C) forjudging that said binary test image originates from a different object than said binary registered 
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image when said predetermined condition of concordance is not satisfied until a successive displacement of 
the m-th order of said partial intervals, so as to carry out rapid comparison by said comparing means, 

12. An image processing apparatus according to claim 2, further comprising : 

5 

means (WH) for discovering holes in said binary registered image, each hole being an aggregate of white 
pixels surrounded by black pixels ; 

means (C4) for judging concordance of said binary test image and binary registered image wherein a hole in 
said registered image is determined to have a corresponding hole In said binary test image when addresses 
10 of said two holes satisfy a predetermined relationship, and said two images are regarded to be originated from 

a same object if a number of corresponding holes between said binary registered image and said binary test 
image lies within a predetermined range. 

13. An image processing apparatus according to claim 2, further comprising : 

15 

image reversing means (RVR) for obtaining a reverse image of said test image and said stored registered 
image ; 

means (RVR2) for converting said reverse test image and said reverse registered image into a binary reversed 
test image and a binary reversed registered image, respectively, so that a ratio of black pixels to total pixels 
20 lies within the first predetermined range ; 

means for storing address information of black pixels of said binary reversed test image and said binary re- 
versed registered image ; 

means (C2, C3) for comparing said binary registered image with said binary test image for evaluating a first 
degree of concordance ; 

25 means for comparing the binary reversed test image with said binary reversed registered image to evaluate 

a second degree of concordance ; and 

means (C5) for determining that the test image and said stored registered image originate from the same 
object if both said first and second degrees of concordance evaluation satisfy respective predetermined range. 

30 

PatentansprOche 

1. Verfahren zum Verarbeiten von Bildern zum Vergleichen eines Testbildes mit einem oder mehreren registrierten 
Bildem und zum Beurteilen, ob das Testbild von dem gleichen Objekt wie eines der registrierten Bilder herruhrt, 
35 mit folgenden Schritten: 

a) Speichem eines registrierten Bildes in einem Bildspeicher; 

b) binares Umwandeln (B1) des registrierten Bildes in ein binares registriertes Bild mit jedem Helligkeftswert 
von jedem Pixel des registrierten Bildes, wobei das binare Umwandeln umfaGt: 

40 c) Bestimmen (B1c), ob ein Verhaltnis einer Gesamtzahl von schwarzen Pixeln zu einer Gesamtzahl von 

schwarzen Pixeln und weiBen Pixeln in dem binar registrierten Bild in einem ersten vorbestimmten Bereichs 
1st; und, wenn das Verhaltnis nicht in dem ersten vorbestimmten Bereich ist, erneutes Starten von Schritt b) 
und Schritt c) durch Andem eines oder mehrerer Schwellenwerte, bis ein binares, registriertes Bild das Ver- 
haltnis in dem ersten vorbestimmten Bereich aufweist; 

45 

und femer mit: 

d) AusdQnnen des binSr registrierten Bildes, urn ein ausgedunntes binares, registriertes Bild zu erhalten; 

e) Speichern und binares Umwandeln eines Testbildes auf die gleiche Art und Weise wie das registrierte Bild 
50 und Erhaften eines binaren Testbildes; 

0 Vergleichen (CO, C1 , C2) des ausgedunnten binaren, registrierten Bildes und des binaren Testbildes, urn 
zu bestimmten, ob das binare Testbild von dem gleichen Objekt wie das registrierte Bild herruhrt, 

und das Vergleichen umfaQt 

55 g) Bestimmen (W3b), daB ein schwarzes Pixel des ausgedunnten binaren, registrierten Bildes mit einem Pixel des 

binaren Testbildes konkordant ist, entweder wenn ein Helligkeitswert des schwarzen Pixels des ausgedunnten 
binaren, registrierten Bildes mit einer Adresse mit einem Helligkeitswert des Pixels des binfiren Testbildes einer 
entsprechender Adresse konkordant 1st, oder mft einem Helligkeitswert eines benachbarten Pixels des Pixels des 
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binaren Testbildes konkordant ist; 
und femer mit, 

h) Beurteilen (C5), ob ein Grad einer Konkordanz zwischen dem binaren Testbild und dem ausgedunnten binfiren, 
registrierten Testbild eine vorbestimmte Konkordanzbedingung erfullt, und Bestimmen gemfiB dem Grad der Kon- 
kordanz, ob das binare Testbild von dem glelchen Objekt wie das registrierte Bild herruhrt. 

Bildverarbeitungsvorrichtung, die ein oder mehrere registrierte Bilder speichert und aufweist: 

Mittel zum binaren Urn wandeln (B1) eines registrierten Bildes in ein binares, registriertes Bild, wobei das 
Mittel zum binfiren Umwandeln bestimmt (B1c), ob ein Verhaltnis einer Gesamtzahl von schwarzen Pixeln zu einer 
Gesamtzahl von schwarzen Pixeln und weiQen Pixeln in dem registrierten Bild in einem ersten vorbestimmten 
Bereich ist, und, wenn das Verhaltnis nicht in dem ersten vorbestimmten Bereich ist, das binare Umwandlungsrnittel 
das registrierte Bild emeut durch Andem eines Oder mehrerer Schwellenwerte umwandelt, bis ein binares regi- 
striertes Bild das Verhaltnis in dem ersten vorbestimmten Bereich aufweist; 
undfernermit: 

Mittel zum Ausdiinnen des binaren, registrierten Bildes; 

Mittel zum binaren Umwandeln eines Testbildes auf die gleiche Art und Weise wie das registrierte Bild; 
Mittel zum Vergleichen (CO, C1 , C2) des ausgedunnten binaren, registrierten Bildes und des binaren Testbil- 
des, urn zu bestimmten, ob das binare Testbild von dem glelchen Objekt wie das registrierte Bild herruhrt, 
wobei das Mittel zum Vergleichen gekennzeichnet ist durch 

Mittel zum Bestimmen (W3b), das ein schwarzes Pixel des ausgedunnten binaren, registrierten Bildes mit 
einem Pixel des binaren Testbildes (ibereinstimmt, entweder, wenn ein Heliigkeitswert eines schwarzen Pixels 
des ausgedunnten binaren, registrierten Bildes mit einer Adresse mit einem Heliigkeitswert des Pixels des 
binaren Testbildes einer entsprechenden Adresse konkordant ist, oder einem Heliigkeitswert eines benach- 
barten Pixels des binfiren Testbildes entspricht; 

und femer mit 

Mittel zum Beurteilen (C5), ob ein Grad einer Konkordanz zwischen dem binaren Testbild und dem binaren, 
registrierten Testbild eine vorbestimmte Konkordanzbedingung erfullt; und zum Bestimmen gemaB dem Grad der 
Konkordanz, ob das binare Testbild von dem gleichen Objekt wie das registrierte Bild herruhrt. 

Bildverarbeitungsvorrichtung gemaB Anspruch 2, ferner mit, 

Mittel (IN) zum Fixieren eines Testbildes wahrend einer Eingabe von einer Bildeingabe in einen Bildspeicher, 
welches Mittel (IN) zum Beurteilen eingegebener Bilder als gultig umfaBt, wenn der durchschnittliche Heliig- 
keitswert in einem vorbestimmten Bereich ist, und 

Mittel (ET) zum Modifizieren des eingegebenen Bildes in ein modifiziertes Bild, das eine erforderliche Anzahl 
von Pixeln zur Vergleichsverarbeitung aufweist. 

Bildverarbeitungsvorrichtung gemaB Anspruch 2, bei der das Mittel (Bi) zum binaren Umwandeln umfaBt: 

Mittel zum Aufteilen (B1a) des Testbildes in eine Mehrzahl von Teilregionen, 
Mittel (B1b) zum Erhatten einer durchschnittiichen Helligkeit fur jede der Mehrzahl von Teilregionen, 
Mittel (B1c) zum Bestimmen eines Schwellenhelligkeitswert fur jede der Mehrzahl von Teilregionen und zum 
Umwandeln des Testbildes in ein binares Testbild mit Bezug auf den Schwellenhelligkeitswert jeder der Teil- 
regionen und der jeder Teilregion benachbarten Regionen, und Mittel zum Emalten des Verhaltnisses der 
Gesamtzahl von schwarzer Pixeln zu der Gesamtzahl von schwarzen Pixeln und weiBen Pixeln, und 
Mittel (B1c) zum Wiederholen der binfiren Umwandlung des Testbildes, urn den Schwellenhelligkeitswert zu 
andern, bis das Verhaltnis von schwarzen Pixeln zu der Gesamtzahl von schwarzen Pixeln und weiBen Pixeln 
in dem ersten vorbestimmten Bereich ist, wobei das nach der wiederholten Umwandlung erhaltene Testbild 
zum Vergleich mit dem binfiren registrierten Bild verwendet wird. 

Bildverarbeitungsvorrichtung gemaB Anspruch 4, ferner mit: 

Mittel (B1 b) zum Bestimmen des Schwellenhelligkeitswerts einer Teilregion mit Bezug auf den durchschnitt- 
iichen Heliigkeitswert (Bav(x.y)) der Teilregion und mindestens einer durchschnittiichen Helligkeit von mindestens 
einer benachbarten Teilregion, 

Bildverarbeitungsvorrichtung gemfiB Anspruch 4, bei der der Schwellenhelligkeitswert einer Teilregion bestimmt 
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wird, um gleich einem vorbestimmten Wertzu sein, wenn derdurchschnittllche Helligkeitswert (Bav(x,y)) derTeil- 
region in elnem vorbestimmten Bereich liegt und jeder Differenzbetragswert • zwlschen dem durchschnittlichen 
Helligkeitswert undjedem Helligkeitswert (f(x,y)) jedes Pixels derTeilregion - In elnem vorbestimmten Bereich liegt. 

7. Bildverarbeitungsvorrichtung gemaB Anspruch 2, bei der das Mittel (2, 3) zum Vergleichen ferner einen Grad einer 
Dlskordanz zwlschen dem bin&ren Testblld und dem blnfiren, registrierten Bild durch Erfassen einer Diskordanz 
von schwarzen Pixeln des binaren Testbildes nach Ausdunnen und schwarzen Pixeln des registrierten Bildes 
bestimmt und den Grad der Diskordanz mit einem vorbestimmten Wert vergleicht. 

8. Bildverarbeitungsvorrichtung gemaB Anspruch 2, ferner mit Mittel zum Speichem (R) von Bilddaten, welches Mittel 
zum Komprimieren und Aufzeichnen (G) von Bilddaten als eine komprimierte Adressen information schwarzer Pixel 
in einer Mehrzahl von Pixel-Aggregationen eines gultigen Bildes aufweist, 

wobei die komprimierte Adresseninformation eine Position auf der X-Achse von schwarzen Pixelh in einer 
Pixel-Aggregation, einen Code und FormaMdentifikationsdaten der jeweiligen Pixel-Aggregation umfaBt. 

9. Bildverarbeitungsvorrichtung gemaB Anspruch 2, bei der das Mittel (CO, C1 ) zum Vergleichen des ausgedunnten 
binaren, registrierten Bildes und des binaren Testbildes ein Mittel (CO) zum Bewegen mindestens eines derbeiden 
binaren Bilder in einem oder mehreren Intervallen aufweist, um die beiden binaren Bilder zu vergleichen, wobei 
jedes der ein oder mehreren Intervallen in einer Mehrzahl von Teilintervallen aufgeteilt ist, 

Mittel (C) zum Beurteilen, ob das binare Testbild eine vorbestimmte Bedingung einer Konkordanz und Diskor- 
danz mit dem binaren registrierten Bild in einem der Teilintervalle erfullt, 

Mittel (C) zum aufeinanderfolgenden Verschieben des einen Teilintervalls, bis die vorbestimmte Bedingung 

der Konkordanz und Diskordanz erfullt ist, 

Mittel (C3) zum Prufen nicht ubereinstimmender Abschnitte und 

Mittel (C5) zum Beurteilen des binaren Testbildes als von einem gleichen Objekt herruhrend basierend auf 
einer vorbestimmten Bedingung einer Konkordanz und Diskordanz und auf den Ergebnissen von dem Pruf- 
mittel. 

10. Bildverarbeitungsvorrichtung gemaB Anspruch 2, ferner mit Mittel zum Ausrichten des binaren Testbildes und des 
ausgedunnten binaren registrierten Bildes, 

und wobei das Mittel (C) zum Beurteilen weiter gemaB dem Grad der Konkordanz und einem Grad von 
Diskordanz beurteilt, ob das binare Testbild von einem gleichen Objekt wie das ausgedunnte, registrierte Bild 
herruhrt. 

1 1 . Bildverarbeitungsvorrichtung gemaB Anspruch 2, ferner mit Mittel zum Ausrichten (CO, C1 ) des binaren Testbildes 
mit dem ausgedunnten binaren, registrierten Bild mit: 

Mittel (C1 , W) zum Bewegen mindestens eines derbeiden binaren Bilder in einem oder mehreren Intervallen, 
um die beiden binaren Bilder zu vergleichen, wobei jedes der ein oder mehreren Intervalle in eine Mehrzahl 
von N Teilintervallen aufgeteilt ist, und 

Mittel zum Beurteilen, ob das binfire Testbild eine vorbestimmte Konkordanzbedingung mit dem binaren re- 
gistrierten Bild in einem der N Teilintervalle erfullt; 

Mittel zum aufeinanderfolgenden Verschieben der N Teilintervalle von einer m-ten (m ist eine positive Zahl) 
Ordnung der Teilintervalle; 

Mittel (C, W) zum Beurteilen, daB das binfire Testbild von einem gleichen Objekt als das binare, registrierte 
Bild herruhrt, wenn die vorbestimmte Konkordanzbedingung vor der m-ten Ordnung der aufeinanderfolgenden 
Verschiebung erfullt ist, und 

Mittel (C) zum Beurteilen, daB das binare Testbild von einem unterschiedlichen Objekt als das binare regi- 
strierte Bild herruhrt, wenn die vorbestimmte Konkordanzbedingung bis zu einem aufeinanderfolgendes Ver- 
schieben der m-ten Ordnung der Teilintervalle nicht erfullt ist, um so einen schnellen Verglelch durch das 
Vergleichsmittel durchzufuhren. 

12. Bildverarbeitungsvorrichtung gemfiB Anspruch 2, ferner mit: 

Mittel (WH) zum Entdecken von Lochem in dem binaren, registrierten Bild, wobei jedes Loch eine Aggregation 
von von schwarzen Pixeln umgebenden weiBen Pixeln Ist; 

Mittel (C4) zum Beurteilen der Konkordanz des blnfiren Testbildes und des binaren, registrierten Bildes, wobei 
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bestimmt wird, daB ein Loch in dem registrierten Bild ein entsprechendes Loch in dem binfiren Testbild auf- 
zuwelsen hat, wenn die Adressen der belden Locher elne vorbestlmmte Beziehung erfullen, und die belden 
Bilder als von elnem glelchen Objekt herrfihrend angesehen werden, wenn elne Anzahl entsprechender Locher 
zwischen dem binaren, registrierten Bild und dem binfiren Testbild in einem vorbestimmten Bereich liegt. 

13. Blldverarbeitungsvorrichtung gemfiB Anspruch 2, fernermit: 

Bildumkehrmittel (RVR) zum Erhalten eines Umkehrbildes des Testbildes und des gespeicherten, registrierten 
Bildes; 

Mittel (RVR2) zum Umwandeln des Umkehrtestbildes und des registrierten Umkehrbildes in ein binfires, um- 
gekehrtes Testbild bzw. ein binares, umgekehrtes, registriertes Bild, so daB ein Verhaltnis von schwarzen 
Pixeln zu Gesamtpixeln in dem ersten vorbestimmten Bereich liegt; 

Mittel zum Speichern von Adresseninformation der schwarzen Pixel des binaren, umgekehrten Testbildes und 
des binaren, umgekehrten, registrierten Bildes; 

Mittel (C2, C3) zum Vergleichen des binaren, registrierten Bildes mit dem binaren Testbild zum Auswerten 
eines ersten Grades von Konkordanz; 

Mittel zum Vergleichen des binaren , umgekehrten Testbildes mit dem binaren, umgekehrten, registrierten Bild, 
urn einen zweiten Grad von Konkordanz auszuwerten; und 

Mittel (C5) zum Bestimmen, daB das Testbild und das binSre, registrierte Bild von dem gleichen Objekt her- 
ruhren, wenn sowohl der erste als auch der zweite Grad der Konkordanzauswertung einen jeweiligen vorbe- 
stimmten Bereich erfullen. 



Revendications 

25 

1 . Procede pour traiter des images pour comparer une image de test avec une ou plusieurs images enregistrees et 
pour estimer si lesdites images de test proviennent du meme objet que Tune des images enregistrees et compre- 
nant les stapes de traitement consistant k : 

30 a) mdmoriser une image enregistree dans une m6moire d'image ; 

b) convertir en binaire (B1) ladite image enregistree en une image enregistree binaire en utilisant chaque 
valeur de luminance de chaque pixel de ladite image enregistree, et ladite conversion binaire comprend : 

c) la determination (B1c) si un rapport entre un nombre total de pixels noirs et un nombre total de pixels noirs 
et de pixels blancs de ladite image enregistree binaire se situe k I'interieur d'une premiere plage 

35 predetermin6e ; et, si ledit rapport ne se situe pas k I'interieur de la premiere plage pr6d6termin6e, recom- 

mencer l'6tape b) et l'6tape c) en modtfiant une ou plusieurs valeurs de seuil jusqu'& ce qu'une image enre- 
gistree binaire presente ledit rapport k I'interieur de la premiere plage pr6determinee ; 

et comprenant, de plus : 

40 

d) Teclaircissement de ladite image enregistree binaire afin d'obtenir une image enregistree binaire eclaircie, 

e) la memorisation et la conversion en binaire d'une image de test de la meme manifcre que ladite image 
enregistree et I'obtention d'une image de test binaire ; 

f) la comparison (CO, C1 , 02) de ladite image enregistr6e binaire eclaircie et de ladite image de test binaire 
45 pour determiner si ladite image de test binaire provient du m§me objet que ladite image enregistree, 

et ladite comparaison comprend : 

g) la determination (W3b) si un pixel noir de ladite image enregistr6e binaire eclaircie coincide avec un pixel 
de ladite image de test binaire, soit lorsqu'une valeur de luminance dudit pixel noir de ladite image enregistree 

so binaire eclaircie ayant une adresse coincide avec une valeur de luminance dudit pixel de ladite image de test 

binaire ayant une adresse correspondante, soit coincide avec une valeur de luminance d'un pixel voisln dudit pixel 
de ladite image de test binaire ; 
et comprend, de plus : 

h) Testimation (C5) si un degre de concordance entre ladite Image de test binaire et ladite image enregistree 
55 binaire eclaircie satisfait k une condition de concordance predeterminee, et la determination si ladite image de 

test binaire provient du merne objet que ladite image enregistree en fonction dudit degr6 de concordance. 

2. Appareil de traitement d'image memorlsant une ou plusieurs images enregistrees et comprenant : 
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des moyens pour convertir en binaire (B1) une image enregistree en une image enregistree binaire, dans 
lequel lesdits moyens pour convertir en binaire determined (B1c) si un rapport entre un nombre total de pixels 
nolrs et un nombre total de pixels noirs et de pixels blancs de ladite image enregistree se situe a Pinterieur d'une 
premiere plage predetermined et, si ledit rapport ne se situe pas a rinterieur de ladite premiere plage predetermi- 
ned, lesdits moyens de conversion binaire convertissent de nouveau ladite image enregistree en modifiant une 
ou plusieurs valeurs de seuil Jusqu'a ce qu'une Image enregistree binaire prdsente ledit rapport a rinterieur de la 
premiere plage predetermined ; 

et comprenant, de plus : 

des moyens pour eclaircir ladite image enregistree binaire ; 

des moyens pour convertir en binaire une image de test de la meme maniere que ladite image enregistree ; 
des moyens pour comparer (CO, C1, C2) ladite image enregistree binaire eclaircie et ladite image de test 
binaire afin de determiner si ladite image de test binaire provient du meme objet que ladite image enregistree, 
dans iequel lesdits moyens pour comparer sont caracte rises par, 

des moyens pour determiner (W3b) qu'un pixel noir de ladite image enregistree binaire eclaircie coincide avec 
un pixel de ladite image de test binaire, soit lorsqu'une valeur de luminance d'un pixel noir de ladite image 
enregistree binaire eclaircie ayant une adresse coincide avec une valeur de luminance dudit pixel de ladite 
image de test binaire ayant une adresse correspondante, soit coincide avec une valeur de luminance d'un 
pixel voisin de ladite image de test binaire ; 

et comprenant, de plus : 

des moyens pour estimer (C5) si un degr6 de concordance entre ladite image de test binaire et ladite image 
enregistree binaire satisfait a une condition predetermin6e de concordance, et pour determiner si ladite image de 
test binaire provient du meme objet que ladite image enregistree en fonction dudit degre de concordance. 

Appareil de traitement d'image selon la revendication 2, comprenant, de plus : 

des moyens (IN) pour fixer une image de test pendant I'entr6e d'une image entree dans une memoire d'image, 
comprenant des moyens (IN) pour estimer que les images entrees sont valides lorsque la valeur de luminance 
moyenne se situe a rintedeur d'une plage predeterminee, et 
des moyens (ET) pour modifier, 

Timage entr6e en une image modifiee comportant un nombre requis de pixels pour le traitement de compa- 
rison. 

Appareii de traitement d'image selon la revendication 2, dans lequel lesdits moyens (B1 ) pour effectuer une con- 
version binaire comprennent : 

des moyens pour diviser (B1 a) ladite image de test en une piuralite de regions partielles, 
des moyens (B1b) pour obtenir une luminance moyenne pour chacune de la piuralite de regions partielles, 
des moyens (B1c) pour determiner une valeur de luminance de seuil pour chacune de la piuralite de regions 
partielles et pour convertir ladite image de test en une image de test binaire avec reference a la valeur de 
luminance de seuil de chacune desdites regions partielles et des regions voisines de chacune desdites regions 
partielles, et des moyens pour obtenir le rapport entre le nombre total de pixels noirs et le nombre total de 
pixels noirs et de pixels blancs, 

et des moyens (B1 c) pour r6p6ter ladite conversion binaire de ladite image de test afin de modifier ladite valeur 
de luminance de seuil jusqu'a ce que ledit rapport entre les pixels noirs et le nombre total de pixels noirs et 
de pixels blancs se situe a rinterieur de ladite premiere plage predeterminee, Pimage de test binaire obtenue 
apres la conversion rep6t6e etant utilis6e pour la comparaison avec ladite image enregistree binaire. 

Appareil de traitement d'image, seion la revendication 4, comprenant, de plus : 

des moyens (B1b) pour determiner ladite valeur de luminance de seuil d'une region partielle avec reference 
a ladite valeur de luminance moyenne (Bav(x.y)) de ladite region partielle et au moins une luminance moyenne 
d'au moins une region partielle voisine. 

Appareil de traitement d'image selon la revendication 4, dans lequel ladite valeur de luminance de seuil d'une 
region partielle est determin6ecomme etant 6gale a une valeur pr6determin6e si ladite valeur de luminance moyen- 
ne (Bav(x.y)) de ladite region partielle se situe a rinterieur d'une plage pr6d6termin6e et si chaque valeur de 
difference absolue entre ladite valeur de luminance moyenne et chaque valeur de luminance (f(x,y)) de chaque 
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pixel de tadite region partielle se situe a I'interieur tfune plage pr6d6tenmin6e. 

7. Apparell de traltement d'lmage selon la revendlcatlon 2, dans lequel lesdits moyens (2, 3) pour comparer d6ter- 
minent, de plus, un degr6 de discordance entre tadite image de test binaire et ladite image enregistree binaire en 
detectant une discordance des pixels noirs de ladite image de test binaire apres eclaircissement et des pixels 
nolrs de ladite image enregistree, et comparent ledit degr6 de discordance avec une valeur pr6d6terminee. 

8. Appareil de traitement d'image selon la revendication 2, comprenant, de plus, des moyens pour memoriser (R) 
des donn6es d'image comprenant des moyens pour compresser et enregistrer (G) des donn6es d'lmage en tant 
qu'informations d'adresse compressees des pixels noirs dans une plurality aggregations de pixels d'une image 
valide, 

dans lequel lesdites informations d'adresse compress6es comprennent une position sur i'axe X de pixels 
noirs dans une agnkjation de pixels, un code et des donn6es ^identification de format de I'agregation de pixels 
respective. 

9. Appareil de traitement d'image selon la revendication 2, dans lequel lesdits moyens (CO, C1) pour comparer ladite 
image enregistree binaire eclaircie et ladite image de test binaire comprennent des moyens (CO) pour deplacer 
au moins Tune des deux images binaires dans un ou plusieurs intervailes afin de comparer lesdites deux images 
binaires, dans lequel chacun desdits un ou plusieurs intervailes est divis6 en une plurality d'intervalles partiels, 

des moyens (C) pour estimer si ladite image de test binaire satisfait a une condition predeterminee de con- 
cordance et de discordance avec ladite Image enregistree binaire dans Tun desdits intervailes partiels, 
des moyens (C) pour deplacer successivement ledit un intervalie partiel jusqu'a ce que ladite condition pre- 
determined de concordance ou de discordance soit satisfaite, 
des moyens (C3) pour verifier les sections discordantes, et 

des moyens (C5) pour estimer si ladite image de test binaire provient d'un mdme objet sur la base de la 
condition predeterminee de concordance et de discordance et des rdsultats provenant des moyens de verifi- 
cation. 

10. Appareil de traitement d'image selon la revendication 2, comprenant, de plus, des moyens pour aligner ladite 
image de test binaire et ladite image enregistree binaire eclaircie, 

et dans lequei lesdits moyens (C) pour estimer, estiment, de plus, si ladite image de test binaire provient 
d'un mdme objet que ladite image enregistree eclaircie en fonction dudit degre de concordance et d'un degr6 de 
discordance. 

11. Appareil de traitement d'image selon la revendication 2, comprenant, de plus, des moyens pour aligner (CO, C1) 
ladite image de test binaire avec ladite image enregistree binaire eclaircie comprenant : 

des moyens (C1 , W) pour deplacer au moins Tune des deux images binaires dans un ou plusieurs intervailes 
afin de comparer lesdites deux images binaires, dans lequel chacun desdits un ou plusieurs intervailes est 
divise en une plurality de N intervailes partiels, et 

des moyens pour estimer si ladite image de test binaire satisfait a une condition pred6termin6e de concordance 
avec ladite image enregistree binaire dans fun desdits N intervailes partiels ; 

des moyens pour deplacer successivement lesdits N intervailes partiels d'un m-ieme ordre (m est un nombre 
positif) desdits intervailes partiels ; 

des moyens (C, W) pour estimer si ladite image de test binaire provient d'un meme objet que ladite image 
enregistree binaire lorsque ladite condition predetermin6e de concordance est satisfaite avant le m-ieme ordre 
de deplacement successif ; et 

des moyens (C) pour juger si ladite image de test binaire provient d'un objet different de ceiui de ladite image 
enregistree binaire lorsque ladite condition predetermin6e de concordance n'est pas satisfaite jusqu'a un de- 
placement successif du m-ieme ordre desdits Intervailes partiels, de manlere a effectuer une comparison 
rapide a Paide desdits moyens de comparaison. 

12. Appareil de traitement d'image selon la revendication 2, comprenant, de plus : 

des moyens (WH) pour decouvrir des trous dans ladite image enregistree binaire, chaque trou etant un agre- 
gafde pixels blancs entoures de pixels nolrs ; 

des moyens (C4) pour estimer une concordance de ladite Image de test binaire et de ladite image enregistree 
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binaire, ou un trou dans ladlte Image enregistree est determine comme ayant un trou correspondant dans 
ladite image de test binaire lorsque les adresses desdfts deux trous satisfont a. une relation pr6d6termin6e, 
et lesdites deux images sont consid£r£es comme provenant d'un meme objet si un nombre de trous corres- 
pondents entre ladite image enregistree binaire et ladite image de test binaire se situe & Hnterieur cTune plage 
5 pr6d6termin6e. 

13. Appareil de traitement cfimage selon la revendication 2, comprenant, de plus : 

des moyens diversion d'image (RVR) pour obtenir une image inverse de ladite image de test et de ladite 
io image enregistree m6moris6e ; 

des moyens (RVR2) pour convertir ladite image de test inverse et ladite image enregistree inverse en une 

image de test inverse^ binaire et en une image enregistree inversge binaire, respectivement, de sorte qu'un 

rapport entre les pixels noirs et la totality des pixels se situe & i'interieur d'une premiere plage pr6d6termln6e ; 

des moyens pour memoriser des informations d'adresse de pixels noirs de ladite image de test inversde binaire 
is et de ladite image enregistree invers6e binaire ; 

des moyens (C2, C3) pour comparer ladite image enregistree binaire avec ladite image de test binaire pour 

6valuer un premier degr6 de concordance ; 

des moyens pour comparer i'image de test inverse^ binaire avec ladite image enregistree inversee binaire 
afin d'6valuer un second degr6 de concordance ; et 
20 des moyens (C5) pour determiner que I'image de test et ladite image enregistree memorisee proviennent du 

mdme objet si lesdits premier et second degres devaluation de concordance satisfont a une plage predeter- 
mine e respective. 
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FIG. 2A 



4: IMAGE MEMORY 
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FIG. 3A 
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A 3X3PIXEL AGGREGATION EXAMPLE 

FIG. 3B 
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A 4x4 PIXEL AGGREGATION EXAMPLE 

FIG. 3C 
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A 4x3 PIXEL AGGREGATION EXAMPLE 
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FIG. 4 



(EXAMPLE 1): 

FINGERPRINT 
BOUNDARY 



IMAGE 10 OF IMAGE MEMORY 4 




(EXAMPLE 2): 

FINGERPRINT 
BOUNDARY x! 



IMAGE 10 OF IMAGE MEMORY 4 



UNUSED PORTION WITHIN 
FINGERPRINT AREA 




RT(0)= {RT01 , RT02. RT03, RT04. RT05} 
RB(0)= {RB01.RB02.RB03.RB04} 



(EXAMPLE 3): 

FINGERPRINT 
BOUNDARY 




RT(0)= {RT01.RT02.RT03.RT04.RT05} 
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FIG. 5 

( START ) 



STEP INI 



RESET COUNTER Fa TO "0" 



I 



STEP IN2 



BEGIN INPUT PROCESSING TO IMAGE 
MEMORY, AND TEMPORARILY FIX IMAGE 



I 



STEP IN3 



DOES THE AVERAGE BRIGHTNESS VALUE N 
OF A SPECIFIED REGION OF THE IMAGE 
FALL WITHIN SPECIFIED CONDITIONS? 
(I.E.. IS THE IMAGE VALID?) 





YES 


/STEP IN4 


ADD "1" 


TO Fa 








^STEP IN5 



(iS Fa A SPECIFIED VALUE? ^ 
YES 



STEP IN6 



CORRECTLY DESIGNATE THE 
IMAGE OF THE IMAGE MEMORY 



( END ) 
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FIG. 6 



PROVISIONAL IMAGE 
LEFT MARGIN 



PROVISIONAL IMAGE 
RIGHT MARGIN 



(0.0) 



PROVISIONAL 
IMAGE UPPER- 
MARGIN 



(0. Yb> 



YL 



(O.Yb+YL-1) 



PROVISIONAL 
IMAGE LOWER- 
MARGIN 



(Xa, 0) 



(Xa+XL-1,0) 



-XL- 



SMALL IMAGE REGION 



(Xh.O) 



PROVISIONAL IMAGE REGION 
(WITHIN DOTTED LINE) 



ORIGINAL IMAGE REGION 



(0. Yh) 



S3 
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FIG. 7 



Bav(M, N) : AVERAGE BRIGHTNESS VALUE OF PARTIAL REGION(M.N) 
(0, 0) X = K-M - X 



Bav(0. 0) 



Bav(O.I) 









BavflH. 
N-1) 


Bav(M. 
N-1) 


Bav(M+1. 
N-1) 


Y=K«N 






Bav(M-1. 
N) 


Bav(M, N) 


Bav(M+1. 
N) 








Bav(M-1. 
N+1) 


Bav(M, 
N+1) 


Bav(M+1. 
N+1) 
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FIG. 9A 



( START ) 



SET Da=0. 

A1ra=A2m=A3m=0. 

A1p=A2p=A3p=0 



SET T= AVERAGE BRIGHTNESS VALUE OF PARTIAL REGION+DtDa. 
IN TERMS OF THE (X, Y) RANGE IN WHICH PIXEL(X. Y) EXISTS 
IN THE PARTIAL REGION (M, N) AT THIS TIME, i.e.. THE(X, Y) 
RANGE IN WHICH K»M^X^K»(M+1 AND K'N£Y£K»(N+1 M : 
WHEN f(X,Y)£T,A WHITE PIXEL IS DESIGNATED 
(WHEN REVERSING B/W A BLACK PIXEL IS DESIGNATED); 
WHEN F(X.Y)<T.A BLACK PIXEL IS DESIGNATED 
(WHEN REVERSING B/W A WHITE PIXEL IS DESIGNATED); 
AT THE TIME. OF DETERMINING A WHITE/BLACK PIXEL. 
BLACK PIXEL:ADD "1" TO BLACK PIXEL COUNTER (Bn) 
WHITE PIXEL:ADD "1" TO WHITE PIXEL COUNTER (Wn) 



NOTE:B=BLACK PIXEL 
W=WHITE PIXEL 

® INDICATES A JUMP TO ® OF FIG. 9B 
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FIG. 9B 



i 



FOLLOWING BINARY CONVERSION. THE RATIO OF BLACK PIXELS (Bn) 
(TO WHITE PIXELS (Wn) IS CALCULATED, i. e. .CALCULATE Rbw=Bn/(Bn+Wn)J 
.AND THEN EXAMINE WHETHER Rbwl £Rbw£Rbw2 IS VALID OR NOT. 



VALID 



NORMAL 
COMPLETION 
OF BINARY 
CONVERSION, 



NO 



Rbw>Rbw2 
(BLACK PIXELS 
PREDOMINATE) 

oT> 



Jyes 



Rbw<Rbw1 
(WHITE PIXELS 
.PRED OMINATE) 

< A1m-Q? 



SUBSTITUTE Da-Da1 
FOR Da. SET A1m=A1p=1 



I 



Tye? 



SUBSTITUTE Da+Da1 
FOR Da. SET Alp=Alm=1 



I 



NO 



< A2p=0? > 



< A2i!=0? > 



NO 



.YES 



SUBSTITUTE Da-Da2 
FOR Da. SET A2m=A2p=1 




SUBSTITUTE DatDa2 
FOR Da. SET A2p=A2m=1 







jYES 



SUBSTITUTE Da-Da3 
FOR Da. SET A3m=1 



JYES 



SUBSTITUTE Da+Da3 
FOR Da. SET A3p=1 



1 



( UNSUCCESSFUL COMPLETION OF A 
V THE BINARY CONVERSION J 



NOTE:* INDICATES A JUMP TO * OF FIG.9A 
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FIG. 10 

EXAMPLE OF TABLE G SHOWING VALID REGIONS 

OF A FINGERPRINT (ELEMENT = G (M, N) ) 

(WHEN K = 16.T INDICATES VALID, "0" INDICATES INVALID; 

SHAPE OF THE FINGERPRINT IMAGE IS UNRELATED TO THE 

OTHER FIGURES) 
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FIG. 11 A 
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AN EXAMPLE IN WHICH THE VICINITY 
SURROUNDING PO IS A HOLE 

FIG. 1 1 B 
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AN EXAMPLE IN WHICH THE VICINITY 
SURROUNDING Po IS NOT A HOLE 



NOTE:B=BLACK PIXEL 
W=WHITE PIXEL 



59 



EP 0 623 890 B1 



FIG.12A 
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AN EXAMPLE IN WHICH AN IMAGE MEMORY IS OEVIDED 
USING 4X4 PIXEL AGGREGAT I ONS 

NOTE:B=BLACK PIXEL, W=WHITE PIXEL 



FIG. 12B 
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UPPER HALF OF A 4x4 PIXEL 
AGGREGATION 
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LOWER HALF OF A 4x4 PIXEL 
AGGREGATION 



FIG. 12D 
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RIGHT HALF OF A 4x4 PIXEL AGGREGATION 
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FIG. 13A 



( START ) 



I 



STEP CO 



DIVIDE AN INTERVAL [Smin.Smax] OF S INTO AT LEAST 

ONE PARTIAL INTERVAL [Smin(j). Smax(j)], 

( j=1. 2 Js). AND DETERMINE SELECTION SEQUENCE 



SELECT ONE UNPROCESSED PARTIAL INTERVAL OF S IN 
ACCORDANCE WITH THE SELECTION SEQUENCE. HEREAFTER, 
THE RANGE OF S IS DETERMINED BY THE PARTIAL 
INTERVAL NUMBER j, (j=1, 2, . . . Js), AND PROCESSING 
IS CARRIED OUT 



STEP CI 



L 



STEP CI a 



CALCULATE QUASI -OPTIMAL VALUES (Sa.Ha.Va) OF {S.H.V} 



^STEP C1b 



CALCULATE QUASI -OPTIMAL VALUES {Sb.Hb.Vb} OF {S,H,V} 



/STEP Clc 



CALCULATE QUASI -OPTIMAL VALUES {Sc.Hc.Vc} OF {S,H, V} | 




/ST EP Cld 



CALCULATE DEGREE OF CONCORDANCE T1(j) OF 
SUB-TEMPLATE WITH REGARD TO PRESENT PARTIAL 
INTERVAL NUMBER OF S; RENDER JUDGMENT 

TUTkl 




NOTE: SEE FIG. 13B FOR ® . ® AND © 
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FIG. 15 



C START ) 



[ 



1 



STEP W1 



SEQUENTIAL SELECTION OF UNPROCESSED ANGLE S 



/STEP W2 



CONVERT BLACK PIXEL ADDRESS AGGREGATION(XR. Yr)OF THE 
MODIFIED IMAGE OF A REGISTERED FINGERPRINT WITHIN A 
SPECIFIED RANGE (EITHER RT(O) OR RB(O)) TO THE BLACK 
PIXEL ADDRESS AGGREGATION (Xr@. Yr@) OF THE MODIFIED 
IMAGE OF A NEW REGISTERED FINGERPRINT BY PARALLEL 
DISPLACEMENT FROM AN APPROXIMATE CENTER POINT AND 
COORDINATE AXIS ROTATION OVER ANGLE S 



/STEP W3 



CALCULATE RATE OF CONCORDANCE FROM THE RATIO OF 
THE BLACK PIXEL ADDRESS AGGREGATION OF THE MODIFIED 
IMAGE OF A NEW REGISTERED FINGERPRINT TO THE BLACK 
PIXEL ADDRESS AGGREGATION OF THE MODIFIED IMAGE OF 
A TEST FINGERPRINT. AND THEN PROCEED TO STEP W4.WHEN 
SPECIFIED. A SEARCH IS CONDUCTED FOR A NEIGHBORING 
PIXEL_I_N ORDER IO_C()WECT_THEJ)JSTqRIipN OFANIMAGE 
IN THE CASE WHEN IT IS POSSIBLE TO ABANDON THE 
COMPARISON DURING THIS PROCESS. THE COMPARISON 
PROCESS IS ABANDONED AT THE DISPLACEMENT POSITION 
{S.H.V}AT THIS TIME. AND TH E PROCEDURE MOVES TO STEP W 4 

] /STEP W4 



UNPROCESSED 
S EXIST 



CALCULATE RATE OF CONCORDANCE AT THE TIME OF 
MODIFYING H.V IN THE SAME MANNER AS IN STEP W3 

{ /STEP W 5 

< CHECK WHETHER UNPROCESSED ANGLE S VALUES EXIST> 

/STEP W6 



UN PROCESSED S DO NOT EXIST J ' 



CALCULATE {S.H.V} WHICH WILL MAXIMIZE THE RATES 
OF CONCORDANCE PREVIOUSLY CALCULATED FOR EACH 
RESPECTIVE {S.H.V} AND SET WITH Nm.Nc INTO 
OUTPUT INFORMATION (WHEN ONLY ONE SET {S.H.V} 
IS INPUTTED! THE RATE OF CONCORDANCE OF THIS 
SET REPRESENTS THE OUTPUT INFORMATION) 

I 



( END ) 
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FIG. 16A 

SEARCH EXAMPLE OF NEIGHBORING (APPROXIMATE) AREA 



MODIFIED IMAGE OF 
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FIG. 16B 

RECIPROCAL RELATIONSHIP OF CONCORDANCE 
AND APPROXIMATE CONCORDANCE 



BLACK PIXEL a OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 
(ADDRESS=A) 




BLACK PIXEL d OF MODIFIED 
IMAGE OF TEST FINGERPRINT 
(ADDRESS=A) 


*i 

i 

i 



(CONCORDANCE) 



OVERLAP CHECK© 



/(CONCORDANCE WITH BLACK 
/ PIXEL a OF MODIFIED IMAGE 
Of REGISTERED FINGERPRINT) 



BLACK PIXEL b OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 

(ADDRESS=B) 



V 
/ 



7 



BLACK PIXa e OF MODIFIED 
IMAGE Of TEST FINGERPRINT 
(ADDRESS=E) 



(APPROXIMATE CONCORDANCE) 



BLACK PIXEL c OF MODIFIED 
IMAGE Of REGISTERED FINGERPRINT 
(ADDRESS=C) 



//(APPROXIMATE CONCORDANCE WITH 
/ / BLACK PIXEL b OF MODIFIED IMAGE 
I A OF REG I STERED F I NGERPR I NT) 



(DISCORDANCE) 



( 

OVERLAP CHECK <D 
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FIG. 18 



( START ) 



-STEP RR1 



INPUT SPECIFIED NUMBER OF 
FINGERPRINTS FROM IMAGE 
INPUT UNIT 2 



L 



STEP RR2 



RECIPROCAL COMPARISON OF INPUTTED 
FINGERPRINT IMAGES ACCORDING TO 
A SELECTION PROCESS 



L 



STEP RR3 



WHEN A SPECIFIED NUMBER OF CONCORDANT 
IMAGES RESULTS FROM THE COMPARISON, 
THE REGISTERED INFORMATION OF A 
REGISTERED FINGERPRINT IMAGE AT 
THE TIME OF THE OPTIMUM DEGREE OF CONCORDANCE 
FOR TEMPLATE IS REGISTERED AS AN IMAGE FOR 
REGISTRATION 
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F I G 1 9A ONE TEST FINGERPRINT AND REGISTERED 

INFORMATION FROM N REGISTERED FINGERPRINTS 



TEST 
FINGERPRINT 



-COMPARISON^ 



REGISTERED INFORMATION 1 OF 
REGISTERED FINGERPRINT 1 



REGISTERED INFORMATION 2 OF 
REGISTERED FINGERPRINT 2 



REGISTERED INFORMATION N OF 
REGISTERED FINGERPRINT N 



FIG. 1 9B COMPARISON OF ONE TEST FINGERPRINT AND REGISTERED 
INFORMATION FROM N REGISTERED FINGERPRINTS 



C 



START 



INPUT 



/SEQUENTIAL SELECTION OF 



STEP NA1 



L 



STEP NA2 



'ART I AL SEGMENTS OF 



UN- 
DETECTED/ 



/ALIGNED INTERVALS WITHOUT OVERLAP (WHEN ALL OF THE 
PARTIAL SEGMENTS HAVE BEEN SELECTED. THE PROCEDURE 
'ENDS IN DISCORDANCE), SUBSEQUENTLY. CONDUCT COMPARISON) 
BY SEQUENTIALLY SELECTING REGISTERED INFORMATION 
i (i=1.2. — N); 

WHEN REGISTERED INFORMATION IS DETECTED FROM THE 
COMPARISON PROCESS WHICH IS CONCORDANT WITH THE 
TEST FINGERPRINT. THIS REGISTERED INFORMATION IS 
JUDGED TO BE CONCORDANT. AND THE PROCEDURE THEN 
i ENDS. AFTER COMPARING ALL REGISTERED INFORMATION. 
lWHEN CONCORDANT REGISTERED INFORMATION CANNOT 
^B E DETECTED. THE PROCEDURE RETURNS TO STEP NA2 

I CONCORDANT REGISTERED 
I INFORMATION DETECTED 
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FIG. 20A 

REGISTRATION 



(REGISTRATION START) 

STEP RVR1 

^_ 



REG I STRATI ON PROCESSING OF REGISTERED 
FINGERPRINT. DESIGNATE REGISTRATION 
INFORMATION OF REGISTERED FINGERPRINT 
(USE OF PROCEDURE R) 



STEP RVR2 



WHEN BINARY CONVERTING THE REGISTERED 
FINGERPRINT. REVERSE WHITE AND BLACK 
PIXELS;CONDUCT REGISTRATION PROCESSING 
OF BLACK PIXELS OF REVERSE BINARY 
I MAGE; DESIGNATE SEPARATELY THE REVERSE 
REGISTERED INFORMATION OF REGISTERED 
FINGERPRINT FROM THE REGISTERED 
INFORMATION OF STEP RVR1 
(USE OF PROCEDURE R) 



(REGISTRATION'S) 



EP0 623 890 B1 



FIG. 20B 

COMPARISON 



(comparison start) 

^STEP RV M1 



BINARY CONVERSION OF GRAY-SCALE IMAGE OF 
TEST FINGERPRINT, COMPARISON PROCESSING OF 
BINARY IMAGE AND REGISTERED INFORMATION. 
AT THIS POINT. OMIT CHECK FOR. DEGREE OF 
DISCORDANCE PORTIONS 
(USE OF PROCEDURES C AND W) 



CONCORDANT 



L 



STEP RVM2 



AT THE TIME OF BINARY CONVERSION OF THE 
GRAY-SCALE IMAGE OF TEST FINGERPRINT, 
REVERSE WHITE AND BLACK PIXELS, AND COMPARE 
REVERSE BINARY IMAGE OF TEST FINGERPRINT 
AND REVERSE REGISTERED INFORMATION OF-" 
REGISTERED FINGERPRINT. AT THIS POINT, OMIT 
CHECK FOR DEGREE OF DISCORDANCE PORTIONS 
(USE OF PRXEDURES C AND W) 



CONCORDANT 



CONCORDANT 
COMPARISON 
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